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ABSIEACT 

California Assembly Bill 3406 requires school 
districts to adopt their ovn standards in basic skills. Including 
reading comprehension, writing, and computation. Students must be 
tested at least once in grades 7*9 and tvice in grades 10*11. After 
Juiie, 19B0, students vho do not meet standards vill not receive a 
high school diploma. Assembly Bill 65, the comprehensive school 
finance legislaticn, extended the requirements to elementary schools, 
requiring assessment at least once in grades 4*6. Districts are 
required to provide additional instruction for pupils vho do not meet 
standards. The legislaticn emphasizes student, teacher, and community 
involvement and awareness. To comply legally, districts must: <1) 
establish ^ budget: <2) reviev curriculum for relevance: (3) set 
written standards: <4t adopt alternative means of completing the 
prescribed course of study such &s vork experience, college credit, 
or independent study: and (5\ inform the public about graduation 
requirements and alternatives. Districts may adept other standards 
for students vith diagnosed learning disabilities. Individual schools 
must test students, remediate those vho fail, and confer vlth their 
parents. (CP) 
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The enactment of Assembly Bills 3408 and 65 represented the California Legislature's 
response to a growing public demand for increased emphasis on Xm basic skills in public 
education. The law requires each local education' agency to design a basic skills assessment 
program for its elementary schools and high schools. 

The legislation places the State Board of Education and the State Department of 
Education in the role of providing guidance and technical assistance, white assigning the 
ultimate decision*making authority to each local school district. For example, the legislation 
required the State Board of Education to prepare and distribute to school districts a 
^^framework for assessing pupil proficiency in reading comprehension, writing, and 
cojuputation skills." To fulfill this requirement, the Department developed this process 
guide and two Sample As^ssment Exercises Manuals (one for grades four through six and 
one for grades seven through eleven). This guide was originally distributed in October, 1 977; 
the high school version of the manuals was distributed in March, 1978; and the elementary 
version was distributed in February, 1979^ Both versions of the manuals contain sample 
items (test questions), item specifications, and field test statistics. 

The Department's technical assistance efforts have been a cooperative project of the 
Office of Program Evaluation and Research, the Division of Secondary Education, and 
various other departmental units. As you will note in the acknowledgments, many persons 
from throughout California helped in the development of the guide, and I am especially 
grateful to them and the several school districts that permitted us to use materials they had 
developed in response to the legislative mandate. 

This guide is presented in a looseleaf binder format so that new and updated material may 
be added. The guide is divided into these main sections: 

• I-Leg»t requirements of AB 3408 and related requirements of AB 65 

• II— Interpretation of legislative intent for enacting basic skills assessment 

• III— A step-by^tep implementation guide, including suggested procedures for involving 
the community and helping students with special needs 

• IV— Appendixes, including papers on the legal implications of proficiency assessment 
and the district option of setting differential standards for students with diagnosed 
learning handicaps/disabilities 

• Resource Catalog, including abstracts of assessment resource materials 

I hope the framework developed by the State Department of Education will be a useful 
tool for school districts and offices of county superintendents of schools to use in 
developing proficiency assessment procedures. We welcome any suggestions for including 
additional materials. Please direct your comments and send your sample materials to: 
Proficiency Assessment Project, Office of Program Evaluation and Research, California State 
Department of Education, 721 Capitol Malt, Sacramento, CA 95814. 
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Use of This Guide 



The Technical Assistance Guide for Proficiency Assessment was designed to help 
California school districts comply with current law which requires districts to develop and 
adopt assessment procedures to measure student proficiency attainment in the basic skills. 

'nie step-by-step processes outlined in this S^lde, primarily in Section III, are intended to 
provide a framework for district and school implementation procedures and to demonstrate 
the importance of linking proficiency assessment directly to the goals and objectives of the 
entire instructional program. 

Key steps which districts and individual schools will need to address in order to comply 
with the law include the following, which are discussed in greater detail in Section III of the 
guide: 

District Concerns 

• Defining basic skills, including, but not limited to, reading comprehension, writing, and 
computation 

• Developing or selecting assessment procedures 

• Assigning standards (levels) of proficiency attainment in each skill area 

Individual School Concerns 

• Administering the assessment procedures (tests) and evaluating results 

• Planning conference procedures and supplementary instruction 

• Designing a plan for recording and reporting assessment information 

• Evaluating current instructional programs in light of assessment results 

• Providing for alternative means to complete the prescribed course of study 

Many school districts may find that they have already completed the initial steps out* 
lined in this guide. However, districts are encouraged to examine the contents page to detep 
mine where they can best begin utilizing this guide to develop a local assessment plan. 




Affective learning. Learning which emphasizes a person's 
feelings and emotions; i*e*, leamit^ that capitalizes on a 
person^s feelings, opinions, interests, attitudes, and 
values* 

Applied perfomumce model* A model for generating 
assessment items and exercises* Applied performance 
tests are designed to measure proficiencies and^or 
competencies in the most direct manner possible* For 
example, to assess proficiency In computation, the 
student may be required to make correct change while 
operating a cash register in a local bu^ness* 

Assessment The process of measuring skills and/or their 
development* 

Basic skihs. Those skills, as defined by a school district, 
which wSI allow a pupU to function effectively in 
contemporary society, including at least the skills of 
writing, reading comprehension, and computation* 
I Cognitri^ learning. Learning which emphasizes intellectual 
tasks; le*, knowledge that a person acquires through 
various forms of education* 
Competency, The ability to develop with proficiency basic 
skills in patterned activities which constitute adult 
life-roles* 

Computation. Ability to read, write, ar:J comprehend 
numbers* It also involves manipulating numbers in order 
to perform arithmetical and mathematical operations 
and using these operations in a variety of contexts* 

OiteriofL A reference used to judge and describe behavior, 
such as basic skill development* For example, a score 
(criterion for passing) on a test measuring proficiency in 
a basic skiD could be used to determine whether a person 
can perform at least at an acceptable level to be deemed 
proficient* 

CnterioFH^ferenced measures. Measures developed to deter- 
mine whether an individual can perform acceptably 
when compared to a preestablisfaed standard* 
Diagnosed learning disability. Clinical term used in special 
education. The term diagnosis implies an identification 
of causal factors which interfere with a student's 
learning. The term disability implies a persistent and 
irreversible state* 
Differential standards. Standards set for students with 
diagnosed learning disabilities* Local school district 
governing boards are permitted to set these standards* 
District's assessment procedures. Tests, structured observa- 
tions, work samples, or other forms of instrumentation 
used to gather data on pupU proficiencies* 



Enraute assessment of pupil proficiencies. Measurements 
done at periodic intervals to verify a student's attain- 
ment of functional proficiency levels and to monitor 
a student's skill development* Used as an aid to early 
identification of pupUs lacking proficiency in skills 
necessary to function well in society* 

Functional fmn^er modet A model for generating assess- 
ment items and exercises. The functional model assesses 
whether students can transfer learning from the class- 
room to actual or simulated life situations* Functional 
proficiencies can be assessed in the school setting* For 
example, to assess a student's skill in addition^ the 
student may be required to determine the balance owed 
on a billing invoice listing two or more item entries* 
Reading comprehension could be assessed by requiring 
the student to read a product label and then to answer 
questions pertaining to the directions* 

Goals, A statement of broad general direction or intent* 
The goals of a school district reflect what that district 
expects of its students and schools* 

Item pools. Collections of items or exercises that have been 
constructed from test specifications* These items/ 
exercises are then placed in an assessment device for 
measuring skill attainment* 

Items* Individual test questions or exercises used to 
measure skill development* 

Management plans* Plans that help managers follow ^ 
course of action designed to accomplish a task* The 
plans should make clear who will be involved^ when, and 
how* 

Norm- referenced measures* Measures developed ^'or the 

purpose of comparing an individual's performance to the 

performance of others* 
Proficiency, Level of skUl development which a school 

district believes will give students the ability to function 

effectively in contemporary society* 
PupU assessment Process of obtaining information usable 

for preparing an appropriate instructional program for 

Individual pupUs* 
Reading con^rehension. Processes ranging from recognizing 

alphabetic characters through critical thinking or being 

able to determine specific information which has been 

stated in a reading passage* 
School context model A basic model traditionally used in 

schools for generating assessment items and exercises* 
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For example, to assess a student's computational skilK 
the student may be expected to solve addition problems 
presented in word or numerical form. Reading compre- 
hension may be assessed by asking questions directly 
related to the content of a reading passage. Writing may 
be assessed by recognizing spelling or punctuation errors 
or similar isolated aspects of writing. In the school 



context model, the student is expected to select the best 

answer from a list of possible answers. 
Standard. A statement or series of statements describing the 

acceptable level of skiU development for identifying 

pupils as proficient in a particular basic skill. 
Writing competency. Skills tanging from the mechanics of 

spelling through written composition. 
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I. 

Legal Ftequirennents jbr Prof iciency Standards 
and Their Effect on School Distrias 



Assembly Bill 3408 (Chapter 856, Statutes of 

1976) , which was enacted in Septemlwr, 1976, 
became effective on Janiiary 1, 1977. This legis- 
lation required high school districts and unified 
school districts maintaining junior, senior, and 
four-year high schools to (1) establish district 
proficiency standards in reading comprehension, 
writing, and computation; and (2) assess, on a 
prescribed basis, the performance of students in 
grades seven through twelve* 

Assembly Bill 3408 was substantially modified 
by Assembly Bill 65 (Chapter 894, Statutes of 

1977) , which was enacted on September 17, 1977. 
AB 65 redefined various high school proficiency 
requirements already mandated by AB 3408 and 
added requirements for the adoption of elementary 
school proficiency standards in basic skills by June, 
1979. Since AB 65 was an "urgency statute," these 
changes are now in effect. 

It is important to understand why statewide 
proficiency requirements were modified through 
AB 65. The new law is a comprehensive school 
support and school improvement measure, which 
was designed to move California toward substantial 
compliance with the Serrano mandate, to provide 
adequate funding for services to students with 
special needs, and to put in place a legal framework 
and financial structure for meaningful school 
improvement efforts in kindergarten through grade 
twelve. By modifying proficiency requirements 
through this comprehensive package-, the Legis- 
lature and the (3ovemor hoped to highlight the fact 
that proficiency standards in basic skills are not 
meant to be an **addH)n" or categorical require- 
ment, but an integral part of statewide school 
improvement efforts. 

Prior to the enactment of statewide proficiency 
requirements (AB 3408 and AB 65), the law 
required only locally developed minimum gradua- 
tion requirements, including a course of study and 
general standards of proflciency. After the passage 
of these two bills, the Education Code now 
provides for the following additional requirements: 



• Each governing board of a high school district 
or a unified school district maintaining junior, 
senior, and four-year high schools must adopt 
its own standards of proficiency by June, 
1978, in the basic skills, including, but not 
limited to, reading comprehension, writing, 
and computation. 

• Each governing board of an elementary school 
district or unifled school district maintaining 
grades six or eight, or the equivalent, must 
adopt its own standards of proficiency by 
June, 1979, in the basic skills listed above. 

• High school districts and the elementary 
school districts within the high school dis- 
tricts must coordinate their work in develop- 
ing proficiency standards, and they must 
make the standards well known to parents, 
students, teachers, and the community as a 
whole. Representatives of the high school and 
elementary school districts are required to 
meet with one another to discuss how this 
may be accomplished. 

• In developing proficiency standards, the 
governing boards must involve parents, school 
administrators, teachers, and counselors in the 
process; and students must also be involved in 
the development of standards for the high 
schools. 

• Beginning in 1978-79 for high schools, and in 
1979-80 for elementary schools, the progress 
of students toward meeting proficiency stan- 
dards shall be assessed at least once in grades 
four through six, once in grades seven through 
nine, and twice in grades ten through eleven. 
Once a student has met the standards up to 
prescribed levels for graduation from high 
school, his or her progress need not be 
reassessed. 

• The school principal or the principal's desig- 
nee shall hold a conference with each student 
who does not demonstrate sufficient progress 
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toward mastery of basic skills, and a meeting 
must also be held with the student's parent or 
guardian to discuss the assessment results and 
recommended actions to further the student's 
progress* 

* Districts shall provide appropriate instruction 
it) basic skills for those students who do not 
demonstrate sufficient progress toward mas- 
tery of basic skills. 

• After June, 1980, any student who has not 
met the locally adopted standards of profi- 



ciency shall not receive a diploma of gradua- 
tion from high school* 

■t 

By January I, 1979, governing boards, with 
the active involvement of parents, adminis- 
trators, teachers, and students shall adopt 
alternative means for pupils to complete the 
prescribed course of study mandated in 
existing law. This requirement is not directly 
related to the new requirements for profi- 
ciency standards in the three baste skill areas; 
but it is, nonetheless, an important require- 
ment that districts must address* 



Comparative Analysis of AB 3408 and AB 65 



Assembly Bill 65 created a new article in the 
Education Code that contains (1) the general 
course of study requirements that existed prior to 
enactment of AB 3408; (2) the requirements added 
by AB 3408; and (3) modifications to AB 3408 
and new requirements added by AB 65. 

In an effort to help school districts clearly 
define their responsibilities, the Department of 



Education has prepared a comparative analysis of 
the statewide proficiency requirements. This analy- 
sis identifies each section of the proficiency 
requirements included in AB 65 and compares 
these requirements to those that were in existing 
law (AB 3408)* Also included in the following 
analysis are explanatory comments on the AB 65 
modifications* 



Analysis of Statewide Proficiency Requirements 



Provisions of AB 3408^ 



IVdvisions of AB 65 



Comments 



Local District Requirements 

51224 (8573)* The governing board 
of any school disitict maint^ning a 
high school shall prescribe courses of 
study designed to provide the skills 
and knowledge tequired for adult life 
for pupils attending the schools within 
Its school district* The governing board 
shall prescribe separate courses of 
study, including, but not limited to, a 
coutse of study designed to prepare 
prospective students for admission to 
state colleges and universities and a 
course of study for vocational training. 

51225 (8574). No pupil shall receive 
a diploma of graduation from high 
school who has not completed the 
course of study prescribed by the 



51225* No pupil shall receive a 
diploma of graduation from high 
school who has not completed the 
course of study prescribed by the 



This section was unchanged by AB 
65 and remains in the Education Code. 



Assembly Bill 3408 did not set a 
date by which districts must adopt 
'^alternative means*" AB 65 now sets 
January 1, 1979, as the date by which 



^THe various sections of the Education Code were renumbered tluougti the passa^ of Assembly Biils 
3100 and 3101 (Statutesof 1976); therefore* the new Education Code section numbers are given for the 
provisiom of AB 340S* but the old section numbers are shown in parentheses as an &id to the reader* 
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Analysis of Statewide Proficiency Requirements (Continued) 



Provi^ansof AB340$^ 



Pnyviskmsof AB65 



Comments 



governing board. Requirements for 
graduation sfaall include: 

(a) English 

(b) American history 

(c) American government 

(d) Mathematics 

(e) Science 

(0 Physical education, unless the 
pupil has been exempted pursuant 
to the provisions of this Code 

(g) Such other subjecU as may be 
prescribed 

The governing board, mth the 
active involvement of parents, adminis^ 
trators, teachers, and students, shall 
adopt alternative means for students 
to complete the prescribed course of 
study, which may include practical 
demonstration of skills and compe^ 
tenctes, work experience or other out* 
side school experience, interdisci- 
plinary study, independent study, and 
credit earned at a postsecondary insti- 
tution. Requirements for graduation 
and specifled alternative modes for 
completing the prescribed course of 
study shall be made avaUabte to stu* 
dents, parents, and the public. 



51225.5 (8574^. The govemingboard 
of any school district maintaining a 
junior or senior high school shall, 
by June 1, 1978, adopt standards of 
proficiency in basic skills for students 
attending schools within Us school 
distiict. Governing boards maintaining 
junior high schools located within a 
school district shall adopt those stan- 
dards of proficiency in basic skills 
adopted by the hif^ school district. 
Standards of proficiency shall include, 
but not necessarily be limited to, 
reading comprehension, writing, and 
computation skills and shall be such as 
win enable individual achievement and 
ability to be ascertained and evaluated. 
The governing board may use aca* 
demic standards for graduation distrib- 



governing board. Requirements for 
graduation shall include: 

(a) Enf^sh 

(b) American history 

(c) American government 

(d) Mathematics 

(e) Science 

(Q Physical education, unless the 
pupil has been exempted pursuant 
to the provisions of this Code. 

(g) Such other subjects as may be 
prescnlwd 

The governing board, with the 
active involvement of parents, adminis^ 
trators, teadiers, and students, shall, 
by January 1, 1979, adopt alternative 
means for students to complete the 
prescribed course of study, which may 
include practical demonstration of 
skills and competencies, work expen^ 
ence or other outside school expert 
ence, interdisciplinary study, indepen* 
dent study, and credit earned at a 
postsecondary institution. Require- 
ments for graduation and specified 
alternative modes for completing the 
prescribed course of study shall be 
made available to students, parents, 
and the public. 

51215. The governing board of each 
school district maintaining a junior or 
senior high school shall, by June 1, 
1978, adopt standards of proficiency 
in basic skills for pupils attending 
schools within its school district. 

The governing board of each school 
district maintaining grades 6 or 8, or 
the equivalent, shall, by June 1, 1979, 
adopt standards of proficiency in basic 
skills for pupils attending such grades. 

Such standards shall include, but 
need not be limited to, reading com- 
prehen^on, writing, and computation 
skills, in the English language, neces- 
sary to success in school and life 
experiences, and shall be such as will 
enable individual achievement to be 
ascertained and evaluated. Differential 



governing boards of districts maintain- 
ing hi^ schools must adopt alternative 
irkeans for students to complete the 
prescribed course of study. 



Assembly Bill 65 repealed Educa- 
tion Code Section 51225.5 and 
replaced it with a new Article 2.5 of 
the Education Code, entitled "Student 
Progress, Elementary and Secondary 
Schools.^ This new article includes 
sections 51215, 51216, and 51217. 
The major changes from the original 
AB 3408 requirements include the 
following: 

• Expanding the application of the 
law to elementary schools so that 
governing boards of districts main- 
taining grades six or ei^^t, or the 
equivalent, must now adopt stan- 
dards of proficiency in reading 
comprehen^on, writing, and com- 
putation for those grades by June, 
1979. 



The vuious sections of the Education Code were remimt>e»d through the passage of Assembly Bills 
3100 ttiid 3101 (Sututes of 1976>; thetefoie, the new Education Code section numbeis ire given for the 
provisions of AB 3408, but the old section numbers are shown bi piientheses as an aid to the reader. 
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Analysis of Statewide Proficiency Requirements (Continued) 



Ptovisioiisof AB3408' 



uted by the State Board of Education 
pursuant to Section S575 for this 
purpose. Subsequent to June^ 1980^ 
no pupil shall receive a diploma of 
graduation from high schoo! who has 
not met the standards of proficiency 
in basic skills prescribed by the govern- 
ing board. The governing board may 
adopt differential standards of profi- 
ciency in basic skills for pupUs with 
diagnosed learning disabilities. 

The governing board shall take 
appropriate steps to ensure that indi- 
vidual pupils progress towards profi- 
ciency in basic skills is assessed duiing 
the rcgulat instructional program at 
least one time during the seventh 
through ninth grade experience and at 
least two times during the tenth 
through eleventh grade experience^ 
provided that the progress of any pupil 
who demonstrates proficiency in basic 
skills Tieed not be reassessed. The 
governing board may use performance 
indicators distributed by the State 
Ekiard of Education pursuant to Sec- 
tion 8575 for the purpose of conduct- 
ing such individual pupU assessments. 

In the case of a pupil who does not 
meet district prescribed standards in 
basic skills^ an appropriate school offt- 
dat shall arrange a conference among 
the pupil, the principal or the princi- 
pal's designee^ the parent or guardian^ 
and^ whenever practicable^ a teacher 
familiar with the pupil's progress to 
discuss the results of the individual 
pupil assessment and the need for 
instruction in basic skills. The pupil 
and the parent or guardian shall be 
requested^ in writing, to attend such 
conference. Within five days of the 
time such written request is post- 
marked^ the ^hool shall make a 
reasonable effort to contact the parent 
or guardian by telephone to conrtmuni- 
cate directly the information con- 
tained in the written request. 



Prorvisioas of AB 45 



standards and assessment procedures 
may be adopted fot pupils with diag- 
nosed learning disabilities. 

Governing boards maintaining ele- 
mentary or junior high schools located 
within a school district maintaining 
a high school shall adopt standards 
of proficiency in basic skills which 
are articulated with those standards 
adopted by the school district main- 
taining the high school. 

Designated employees of all school 
districts located within a high school 
district and one or more designees of 
the high school district shall meet 
prior to June U 1979* to plan for 
articulation of elementary and high 
school proficiency standards^ and as 
necessary thereafter lo review the 
effectiveness of such articulation pro^ 
cedures. 

Standards of proficiency shall be 
adopted by the governing board with 
the active involvement of parents 
broadly reflective of the socioeco- 
nomic composition of the district* 
administrators^ teachers* counselors* 
and, with respect to standards in 
secondary schools^ pupils. 



Comments 



• Basic skills proficiency standards 
are now defined to mean standards 
^in the English language* necessary 
to success in school and life 
experiences. . . 

* Governing boards maintaining ele- 
mentary schools or junior high 
schools located within a school 
district maintaining a high school 
must coordinate and articulate their 
standards with those adopted by 
the district maintair-ii^g the high 
school. Designated employees of 
these districts must meet r»rior to 
Jtme 1, 1979, to coordinate these 
standards* and as necessary there- 
after to review the effectiveness of 
articulation procedures. 

« Added emphasis on staff* student* 
and community involvement so 
that standards of proficiency must 
now be adopted by governing 
boards ''with the active involve- 
ment of parents broadly reflective 
of the socioeconomic composition 
of the district* administrators* 
teachers* counselors, and* with re- 
spect to standards in secondary 
schools* pupils." 



'The various sections of the Education Code were [enumbeftd through the pus«ge of Assembly Bills 
3100 And 3101 ^ututes of 197(>; thefefoce* the new Education Code section numbers are given for the 
piovisions of Afi 3408* but the old section numbers ate shown in parentheses as an aid to the reader. 
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Analysts of Statewide Proficiency Requirements (Continued) 



Phwisions of AB 3408' 



Frovi^ons of AB 65 



Comments 



51216. Beginning in the 1978*79 
school year, the governing board of 
each district maintaining a junior or 
senior high school, and beginning in 
the 1979-80 school year, the governing 
board of each district maintaining an 
elementaty school, shall take appropri* 
ate steps to ensure that individual 
pupil progress towards proficiency in 
basic skills is assessed in the English 
language during the 4th through 6th 
grade experience, once during the 7th 
through 9th grade experience, and 
twice during the 10th through 11th 
grade experience, provided that aiiy 
pupil who demonstrates proficiency up 
to prescribed levels for graduation from 
hi^ school need not be reassessed. 
Nothing in this section shall preclude 
any district from conducting an assess- 
ment of any pupil in English and in the 
native language of such pupil. 

It is the intent or the Legislature 
that pupil assessments measure the 
progress of each pupil in mastering 
basic skiils rather than the pupil's 
performance relative to his or her 
classmates. 

In the case of any pupil who does 
not demonstrate suHicient progress 
toward mastery of basic skills so that 
he or she will be able to meet pre* 
scribed standards upon exit from the 
6th, 8th, or 12th grade, whichever is 
appropriate, the principal shall arrange 
a conference among the principal or 
the principal's designee, the parent or 
guardian of the pupil, and a teacher 
familiar with the pupil's progress to 
discuss the results of the individual 
pupi] assessment ^d recommended 
actions to further the pupil's progress. 

The secondary school pupil shall 
attend the conference. The elementary 
school pupil shall attend the confer* 
ence unless the principal's designee 
and the parent or guardian agree that 
such presence would not be In the 
pupil's best interest. 



♦ Assessment of pupil progress 
towards proficiency in basic skills 
must begin in 1978-79 for second* 
ary schools and in 1979-80, for 
elementary schools. Beginning in 
1979*80, assessments must be con* 
ducted at least once during grades 
four through six. As already sped* 
fied by AB 3408, beginning in 
1978-79, assessments must still be 
conducted at least once in grades 
seven through nine and at least 
twice in grades ten through eleven. 

♦ Clarification is provided that 
'^nothing in this (proficiency) sec- 
tion shall preclude any district from 
conducting an assessment o{ zny 
pupil in English and in tlie native 
language of such pupil." This means 
that while proHciency standards 
and assessments related to 'Mer* 
minal'' graduation standards must 
be conducted in English, assessment 
in the pupil's native language may 
also be conducted to plan supple* 
mentary instructional progress or 
for other purposes. 

« Legislative intent on the nature of 
individual assessments is clarified In 
that '^pupil assessments measure the 
progress of each pupil in mastering 
basic skills rather than the pupil's 
performance relative to his or her 
classmates." This means that pupil 
progress must be measured indi- 
vidually against an absolute stan* 
dard of basic skills mastery rather 
than as part of a group compared 
against national, state, district, 
school, or grade *'nornis." 

♦ Requirements for school*parent* 
pupil conferences are clarified as 
follows: 

1 . In the case of a pupil who "does 
not demonstrate sufficient prog* 
ress towards mastery of basic 
skills so that he or she will be 
able to meet prescribed stan* 



^Tbe various seciions of ihe Education Code were renumbered through ihe passage of Assembly Bills 3100 
and 3101 (Siatuies of 1976); therefore, the new Educaiion Code section numbers are given for the provisions of 
AB 3408» bui the old section numbers are shown in parentheses as an aid lo ihe reader. 
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Analysis of Statewide Proficiency Requirements (Continued) 



Pfovisionsof AB340S' 



Provisions of AB 65 



Comments 



51226 ($575). (a) The State Board 
of Education shall by April 1, 1977, 
prepare and distribute to each school 
district maintaining a junior high 
school or high school for its considera- 
tion, examples of minimum academic 
standards for graduation, including 
performance indicators. The Depart* 
ment of Education shall include in this 
distribution the criteria used in devel* 
oping standards of competency in 
basic skills pursuant to subdivision (b) 
of Section 12603 and representative 
examples of items used to test the 
attainment of such standards. These 
examples shall be provided solely to 
assist each school district in the devel* 
opment of its own minimum academic 
standards for graduation and standards 



The pupil and the parent or guard- 
ian shall be requested in writing to 
attend the conference. Such notice 
shall be written in the primary Ian* 
guage of the parent or guardian, when* 
ever practicable. 

Absent a response from the parent 
or guardian, the school shall make a 
reasonable effort to contact him or her 
by other means to communicate 
directly the information contained in 
the written request. 

At the conference^ the principal or 
the principal's designee shall describe 
the instructional program which shall 
be provided to assist the pupil to 
master basic skills. If the parent or 
guardian does not attend the confer* 
ence, the prindpal or the principal's 
designee shall communicate such 
information by other means within 10 
days of the date of the conference* 

Instruction in basic skills shall be 
provided for any pupil who does not 
demonstrate sufticient progress toward 
mastery of basic skills and shall con* 
tinue until the pupil has been given 
numerous opportunities to achieve 
mastery. 

51217. Subsequent to June, 1980, no 
pupil shall receive a diploma of gradu* 
ation from high school if he or she h^ 
not met the standards of proficiency 
in basic skills prescribed by the sec* 
ondary school district goveming 
board. 

The State Board of Education shall, 
by February 1, 1978, prepare and 
distribute to each school district main* 
taiiiing a junior or senior high school, 
and by October I, 1978, prepare and 
distribute to each district maintaining 
an elementary school, a framework for 
assessing pupil proficiency in reading 
comprehension, writing, and computa* 
tion skills. Such framework shall 
include a range of assessment items in 
each skill area. The assessment frame* 



dards upon exit from the 6th, 8th, 
or 12th grade, whichever is appro- 
priate " the principal !s responsi- 
ble for arranging a conference 
with the principal or principalis 
designee, the parent or guardian 
of the pupU, and a teacher famil* 
iar with the pupil's progress. 

2. The high school student shall 
attend the conference. The ele* 
men taiy school pupil shall 
attend the conference unless the 
prindpal's designee and the 
parent or guardian agree that 
such presence would not be in 
the pupil's best interest* 

3. At the conference, school per* 
sonnel shall describe the results 
of the pupiPs assessment and 
shall ''describe the instructional 
program which shall be provided 
to assist the pupil to master 
basic skills*^ Should the parent 
or guardian not attend the con* 
ference, the principal or princi* 
pal's designee must communicate 
the above information by other 
means within ten days of the 
date of the con ference. 

Section 51217 retains the require* 
ment that local districts may not issue 
a diploma of graduation from high 
school after June, 1980, unless a pupil 
has met the district prescribed stan* 
dards of proficiency. 

Section 51217 also clarifies State 
E>epartment of Education require* 
ments, as follows: 

1. The requirement for distribution of 
the April 1, 1977, materials is 
deleted, as these materials have 
already been distributed. 

2. A requirement for **a framework 
for assessing pupil proficiency"^ to 
be distributed to districts maintain* 
ing elementar>' schools by October 
1, 1978, is added to the existing 



^The various sectbns of ihe Education Code were renumbered through the piassstge of Assembly Bills 3 IQO 
and 3101 (Statutes of 1976); therefore, the new Education Code section numbers are given for the provisions of 
AB 3408, but the old section numbers are shown in parentheses as aid to the readerr 
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Anatysis of statewide Proficiency Requirements (Continued) 



Ptovisioiis of AB 3408^ 



Ptovisioiis of AB 65 



Comments 



of proficiency in basic skills as required 
by Section 8574.5 

(b) The State Ekiard of Education 
shall, by February 1» 1978, prepare 
and distribute to each school district 
maintaining a junior high school or 
high school for its consideration, a 
framework for assessing pu|nl proB-^ 
dency in reading comprehension, writ- 
ing, and computation skills. Such 
framework shall include a range of 
assessment items Ln each skOl area in 
order to enable a school district to 
select items consistent with standards 
of proficiency in basic sldtls adopted 
by the district governing board pursu* 
ant to Section 8574*5 

(c) Nothing in this section shall be 
construed to authorize or require the 
State Board of Education to adopt 
statewide minimum academic stan- 
dards for graduation from high school* 

Appropriations 

For State Department of Education 

Section 8* The sum of one hun- 
dred seventy-^five thousand doUars 
(S175,000) is hereby appropriated 
from the General Fund to the 
Department of Education for the 
purpose of preparing and distribut- 
ing the framework for assessing 
pupil proficiency required by Sec- 
tion 8575 of the Education Code. 

For local school districts 

Section 9. Commencing [with the] 
1978-79 fiscal year, the sum of two 
hundred twenty-four thousand dol- 
lars (S224,000) is hereby appropri- 
ated from the General Fund to the 
State Controller for aUocation and 
disbursement to local agencies 
pursuant to Section 2231 of the 
Revenue and Taxation Code to 
reimburse such agencies for costs 
incuned by them in notifying 
pupils and the parents and guard- 
ians thereof pursuant to Section 
8574.5 of the Education Code. 



work shall be provided solely to assist 
each school district In the develop- 
ment of its own pupil assessment as 
requiT/>^d by Section 51216* 

Nothing in this section shall be 
construed to authorize or permit the 
State Etoard of Education to adopt 
statewide minimum proficiency stan- 
dards for high school graduation* 



Section 65* The sum of four hundred 
thousand dollars ($400,000) is hereby 
appropriated from the General Fund 
for transfer to, and in augmentation 
of. Item 300 of the Budget Act of 
1977, for the purpose of preparing and 
distributing the framework for assess- 
ing pupil progress required by Section 
51217 of the Education Code* 



Section 81* Commencing with the 
1978-79 fiscal year, the sum of two 
hundred twenty-^four thousand doUars 
($224,000) is hereby appropriated 
from the General Fund to the State 
Controller for aUocation and disburse, 
ment to districts maintaining junior 
and senior high schools pursuant to 
Section 2231 of the Revenue and 
Taxation Code to reimburse such 
districts for costs incuned by them in 
notifying pupils and the parents and 
guardians thereof pursuant to Section 
51216 of the Education Code. 



requirement that such a framework 
be distributed to districts maintain-^ 
ing junior and senior high schools 
by February 1, 1978. Both frame- 
works are to include "a range of 
assessment items In each skiU area*" 

NOTE: The preceding section 
was further modified by AB 2043, 
passed In 1978, \iduch extended the 
delivery date for the elementary 
framework from October I, 1978, 
to February 1, 1979* 



Section 65 of AB 65 appropriates 
$400,000 to the Department of Edu- 
cation to prepare the framework for 
assessing pupil proficiency and to dis* 
tribute it by October I, 1978, to dis* 
tricts maintaining elemenury schools* 



Section 81 deletes Section 9 of AB 
3408 and reappropriates the same 
$224,000 provided to reimburse dis- 
tricts maintaining junior and senior 
high schools for costs incurred in the 
p arent/guardian and pupil no tifi^ 
cations required by Education Code 
Section 51216* These funds become 
available in 1978-79* 



^The Various sections of the Education C6de were leniimbered through the passage of Assembly BOls 3100 
and 310t (Staluies of 1976): therefore, the new Education Code section numbers are given for the provisions of 
AB 340S, but the old section numbers are shown in parentheses as an aid lo the reader. 
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Analysis of Statewide Proficiency Requirements (Continued) 



Provisioiis of AB 3408^ 


IVdvisions of AB 65 


Conunents 


Section 10. Except as provided in 
Section 9 of this act. and notwith- 
standing Section 2231 of the 
Revenue and Taxation Code, there 
shall be no additional reimburse- 
ment pursuant to this act nor shall 
therc' be any appropriation made by 
thii act because the duties, obb- 
gTitions, or resporisibilitics imposed 
on local governmental entities by 
this act are such that related costs 
arf^ incurred as a part of their 
normal operating procedures. 


Section 82. Commencing with the 
1979-SO fiscal year, the sum of fony- 
six thousand dollars (S46,000) is here- 
by appropriated from the General 
Fund to the State Controller for 
allocation and disbursement to ele- 
mentary school districts maintaining 
grades 6 or S pursuant to Section 
2231 of the Revenue and Taxation 
Code to reimburse such districts for 
costs incurred by them in notifying 
pupils and the parents and guardians 
thereof pursuant to Section 51216 of 
the Education Code* 

Section 80. Except as otherwise pro- 
vided in this act^ and notwithstanding 
Sections 2229, 2230, and 2231 of the 
Revenue and Taxation Code, there 
shall be no additional reimbursement 
pursuant to this act nor shall there be 
any appropriation made by this act 
because the duties, obligations, or 
responsibilities imposed on local 
agencies by this act are either incurred 
as a part of their normal operating 
procedures or funded through other 
appropriations in this act. 


Section 82 provides S46XK)0 for 
the same purposes for districts main- 
taining elementary schools. These 
funds become available in 1979^0. 

Section 80 specified that.other than 
the notification costs described above, 
no other district costs related to profi- 
ciency assessment may be reimbursed 
by the state. This is simply a reitera- 
tion of Section lOof AB3408. 



Education Code Provisions Requiring Proficiency Standards 
(AB 3408 as modified by AB 65) 



SEC 42. It is the intent of the Legislature that 
pupils attending public schools in California 
acquire the knowledge, skills, and confidence 
required to function effectively in contemporary 
society. 

The Legislature finds that high school gradu- 
ation requirements are generally related to ^^seat 
time*' and tied to college entrance requirements. 

The Legislature further ftnds that some pupils 
currently graduating from the public schools lack 
competence in essential communication and com- 
putation skills and the confidence that they can 
cope successfully with a complex society. 



It is the intent and purpose of the Legislature to 
ensure the development of clearly defined profi- 
ciency standards in basic communication and 
computation skills for pupils attending public 
schools. It is the purpose of Section 43 of this act 
to ensure early identification of pupils lacking 
competence in basic skills, so that such pupils can 
receive appropriate assistance to achieve mastery of 
such skills prior to high school graduation. 

U is the purpose of Section 43.5 of this act to 
provide students with opportunities to use com- 
munity education resources and to develop and 
demonstrate their abilities in a variety of educa- 
tional settings. 



The various sections of the Education Code were i^numbered through the (mssage of Assembly Bills 3lOO 
and 3lOl (Statutes of 1976); therefore, the new Education Code secijon numbers are given for the provisions of 
AB 3408f but the old section numbers arc shown in parentheses as an aid to the reader 
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SEC. 43. Article 2.5 (commencing with Section 
51215) is added to Chapter 2 of Part 28 of the 
Education Code, to read: 

Article 2.5. Student Progress^ Elementary and 
Secondary Schools 

51215. The governing board of each school 
district maintaining a junior or senior high school 
shalU by June U 1978, adopt standards of profi- 
ciency in basic skills for pupils attending school 
within its school district. 

The governing board of each school district 
maintaining grades six or eiglu^ or the equivalent^ 
shatl, by June U 1979, adopt standards of profi- 
ciency in basic skills for pupils attending such 
grades. 

Such standards shall include, but need not be 
limited to. reading comprehension^ writings and 
computation skills^ in the English language, neces^ 
sary to success in school and life experiences^ and 
shall be such as will enable individual achievement 
to be ascertained and evaluated. Differential stan*- 
dards and assessment procedures may be adopted 
for pupils with diagnosed learning disabilities. 

Governing boards maintaining elementary or 
junior high schools located within a school district 
maintaining a high school shall adopt standards of 
proficiency in basic skills which are articulated 
with those standards adopted by the school district 
maintaining the high school. 

Designated employees of all school districts 
located within a high school district and one or 
more designees of the high school district shall 
meet prior to June K 1979, to plan for articulation 
of elementary and high school proficiency stan- 
dards, and as necessary thereafter to review the 
effectiveness of such articulation procedures. 

Standards of proficiency shall be adopted by the 
governing board with the active involvement of 
parents broadly reflective of the socioeconomic 
composition of the district, administrators^ teach-^ 
ers, counselors, and. with respect to standards in 
secondary schools, pupils. 

51216. Beginning in the 1978-79 school year, 
the governing board of each district maintaining a 
junior or senior high school, and beginning in the 
1979-80 school year, the governing board of each 
district maintaining an elementary school, shall 
take appropriate steps to ensure that individual 
pupil progress towards proficiency in basic skills is 
assessed in the English language during the regular 
instructional program at least once during the 
fourth through sixth grade experience, once during 



the seventh through ninth grade experience, and 
twice during the tenth through eleventh grade 
experience, provided that any pupil who demon- 
strates proficiency up to prescribed levels for 
graduation from lugh school need not be reas- 
sessed. Nothing in this section shall preclude any 
district from conducting an assessment of any 
pupil in English and in the native language of such 
pupil. 

It is the intent of the Legislature that pupil 
assessments measure the progress of each pupil in 
mastering basic skills rather than the pupiPs per- 
formance relative to his or her classmates. 

In the case of any pupil who does not demon- 
strate sufficient progress toward mastery of basic 
skills so that he or she will be able to meet 
prescribed standards upon exit from the 6th, 8th, 
or 12th grade, whichever is appropriate^ the princi- 
pal shall arrange a conference among the principal 
or the principalis designee^ the parent or guardian 
of the pupil, and a teacher familiar with the pupiPs 
progress to discuss the results of the individual 
pupil assessment and recommended actions to 
further the pupiPs progress. 

Tlie secondary school pupil shall attend the 
conference. The elementary school pupil shall 
attend the conference unless the principaPs desig- 
nee and the parent or guardian agree that such 
presence would not be in the pupiPs best interest. 

The pupil and the parent or guardian shall be 
requested in writing to attend the conference. Such 
notice shall be written in the primary language of 
the parent or guardian, whenever practicable. 

Absent a response from the parent or guardian, 
the schwl shall make a reasonable effort to 
contact him or her by other means to communi- 
cate directly the information contained in the 
written request. 

At the conference^ the principal or the princi- 
palis designee shall describe the instructional pro* 
gram which shall be provided to assist the pupil to 
master basic skills. If the parent or guardian does 
not attend the conference, the principal or the 
principaPs designee shall communicate such infor- 
mation-by other means within 1 0 days of the date 
of the conference. 

Instruction in basic skills shall be provided for 
any pupil who does not demonstrate sufTicient 
progress toward mastery of basic skills and shall 
continue until the pupil has been given numerous 
opportunities to achieve mastery. 

51217. Subsequent to June, 1980, no pupil 
shall receive a diploma of graduation from high 
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school if he or she has not met the standards of 
proficiency in basic skiUs prescribed by the second- 
ary school district governing board. 

The State Beard of Education shall, by February 
1, 1978, prepare and distribute to each school 
district maintaining a junior or senior high school, 
and by October 1* 1978, prepare and distribute to 
each district maintaining an elementary school, a 
framework for assessing pupil proficiency in read- 
ing comprehension, writing, and computation 
skills. Such framework shall include a range of 
assessment items in each skill area. The assessment 
framework shall be provided solely to assist each 
school distrk I in the development of its own pupil 
assessments as required by Section 51216. 

Nothing in this section shall be construed to 
authorize or permit the State Board of Education 
to adopt statewide minimum proficiency standards 
for high school graduation. 

SEC. 43.5. Section 51225 of the Education 
Code is amended to read: 

51225. No pupil shall receive a diploma of 
graduation from high school who has not com- 
pleted the course of study prescribed by the 
governing board. Requirements for graduation shall 
include: 



(a) English 

(b) American history 

(c) American government 

(d) Mathematics 

(e) Science 

(0 Physical education, unless the pupil has 
been exempted pursuant to the provisions 
of this code 

(g) Such other subjects as may be prescribed 

The governing board, with the active involve- 
ment of parents^ administrators, teachers, and 
students, shall, by January 1, 1979, adopt alterna- 
tive means for students to complete the prescribed 
course of study which may include practical 
demonstration of skills and competencies, work 
experience or other outside school experience, 
interdisciplinary study, independent study, and 
credit earned at a postsecondary institution. 
Requirements for graduation and specified alter^ 
native modes for completing the prescribed course 
of study shall be made available to students, 
parents, and the public. 

SEC. 44. Section 51225.5 of the Education 
Code is repealed. 



Questions and Answers About the New Law 



Since AB 3408 became effective on January 1, 
1977) a number of questions were raised concern* 
ing interpretations of certain sections of this law. 
Some of these questions addressed precise legal 
issues; others related to the author*s and the 
Legislature's intent in enacting the law. 

Many of the modifications of AB 3408 con- 
tained in AB 65 were designed to respond to these 
questions. Other questions have been answered by 
various expressions of the author^s or the Legis- 
lature's intent. A few questions and issues remain 
unresolved. 

It is almost impossible for the Department of 
Education to answer precisely and finally any 
unresolved questions for local school districts, 
because the Department has no mechanism for 
issuing legal opinions or legislative interpretations 
that are binding upon local districts. Therefore, to 



obtain binding and protective interpretations on 
legal issues relating to AB 3408, a local district is 
encouraged to seek and receive an opinion from its 
own county counsel. 

The following questions and answers are divided 
into three sections: (1) questions addressed by 
modifications in AB 65; (2) questions clarified 
through various expressions of the author^s or the 
Legislature's intent; and (3) questions that remain 
unanswered. 

Appreciation is expressed to Assemblyman 
Leroy Greene, Chairman of the Assembly Educa- 
tion Committee; Assemblyman Gary K. Hart, 
original author of AB 3408; and the staff of the 
Assembly Education Committee for working 
closely with the Department to develop answers to 
the questions that have been raised about the new 
law. 
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Questions and Answers About Proficiency Assessment 



Option 


Answer 


Questions Addiessed hy 


^ Modifications in AB 65 



I. Do proficiency requirements apply to elemen- 
tary districts? 



2. Do proficiency requirements preclude assess- 
ment or instruction in languages other than 
EngHsh? 



Yes. Education Code Section 51215 now requires 
all districts maintaining grades six or eight, or the 
equivalent, to adopt standards of proficiency in 
reading comprehension, writing, and computation 
by June, 1979. 

No. Education Code sections 51215 and 51216 
specify that standards be established and that 
proficiency be demonstrated in the English lan- 
guage for the purposes of these sections. However, 
Section 51216 also says, ^^Nothing in this section 
shall preclude any district from conducting an 
assessment of any pupil in English and in the native 
language of such pupil." IhLs means assessments in 
languages other than English can be conducted for 
a variety of purposes, including diagnosing the 
instructional needs of limited and non-English 
speaking students and monitoring their progress. In 
fact, in the context of an individualized or group 
bilingual education program, such assessments 
would be highly desirable. 



Questions Clarified by Expressions of Authors or Legislature's Intent 



l.Do proficiency requirements apply to adult 
schools? 



Yes. Insofar as adult schools grant high school 
diplomas consistent with the graduation require- 
ments specified in the Education Code, proficiency 
requirements established under Education Code 
Section 51216 apply to adult schools. 

The above interpretation (the only one included in 
the previous edition of this guide) deals only with 
the requirements of Education Code Section 
51216. Education Code Section 51217, which 
requires that subsequent to June, 1980, no pupil 
shall receive a diploma of graduation from high 
school if he or she has not met the standards of 
proficiency in basic skills prescribed by the district 
governing board, also applies to high school 
diploma programs maintained in adult schools. 

However, the procedural provisions of Education 
Code sections 51215 and 51216 do not apply to 
students defined as adults and enrolled in adult 
school programs. This means that for such stu- 
dents, the requirements for conducting assessments 
at prescribed grade levels, for notifying parent or 
guardian of conferences, and for providing supple* 
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Question 



Answer 



mentary instruction do not apply. Nevertheless, 
adult diploma programs should include appropriate 
periodic assessments to let students know how 
they are progressing toward proficiency. 

Adult education personnel are encouraged to par* 
ticipate in all aspects of the development of any 
proficiency standards which will be applied to 
adult students. In addition, districts may wish to 
establish for aduU programs proficiency standards 
in areas other than basic skills. Suggested guidelines 
and criteria^fot^est_ahlishing a processjhat will lead 
to the development of these competencies or 
proficiencies is being prepared by the Adult Educa- 
tion Field Services Section of the Department of 
Education in conjunction with the California Adult 
Learner Competencies Committee. This infor* 
mation will be disseminated to the field upon its 
completion. 



2. Can districts use successful completion of a 
specified course or set of courses to meet 
proficiency requirements? 



. Will fully or partially completed proficiency 
assessments be "transferable" if a student moves 
from one district to another? If so, how? 



4. Do proficiency requirements apply to children 
of migrant workers? 



5. How will the funds set aside for the costs of 
notifying parents of the results of their chil- 
dren's assessments be distributed? 



Yes, provided that the course or courses include 
instruction in and assessment of pupil mastery of 
the specified basic skills, including demonstration 
of proficiency up to the required district standards. 

The Education Code does not specifically provide 
for reciprocity agreements among school districts 
to accept one another's proficiency standards and 
assessment procedures. However, the author's and 
the Legislature's intent is that districts handle 
reciprocity of proficiency standards as they have 
handled reciprocity of courses of study and other 
graduation requirements in the past. 

Yes. Children of migrant workers are covered by 
these requirements. In the coming months the 
Department of Education will be developing 
recommended procedures to assist districts in 
making known their proficiency standards to the 
children and families of migrant workers. 

Section 81 of AB 65 provides $224,000 for 
disbursement in 1978-79 to districts maintaining 
junior and senior high schools. (This simply re- 
places, and is not over and above, the $224,000 
provided in Section 9 of AB 3408.) Section 82 of 
AB 65 provides $46,000 for disbursement in 
1979*80 to elementary school districts maintaining 
grades six or eight. These funds are provided solely 
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Question 


Answer 




to reimburse districts for costs incurred in parent 
notification, pursuant to Education Code Section 
51216. Funds up to the levels specified will be 
distributed under the provisions of Section 223 1 of 
the Revenue and Taxation Code (the SB 90 local 
mandate section). The State Controller is respon- 
sible for specifying procedures for documenting 
and claiming expenditures under this section. The 
Controller's office has assured the Department that 
claiming procedures for funds available in 1978-79 
will be distributed to districts maintaining junior 
and senior high schools by May 1, 1978. 


Questions About the Differential Standards Option^ 


1. Does the "differential standards option" allow 
districts to exempt special education pupils from 
proficiency requirements? 

2. Can districts develop differential standards for 
pupils who may not be enrolled in special 
education programs but do meet a board* 
adopted definition of '^diagnosed learning 
disabled"? 

3. Can differential standards be set for pupils who 
are low achievers but may not be enrolled in 
special education programs? 


No. Special education pupils are not exempted 
from proficiency standards requirements of the 
Education Code. Rather, the law provides govern- 
ing boards the option of setting different perfor- 
mance standards and assessment procedures for 
some of the pupils enrolled in special education 
programSi. ii oisinccs cnoosc noi lo exercise cne 
option, all pupils in the district are subject to the 
regular district standards* 

No. The recent amendment to the proficiency 
provisions (AB 2043, Chapter 893, Statutes of 
1978) specifies that differential standards may be 
developed only for pupils enrolled in special 
education programs* In order to be eoiroll^d in 
special education programs, a pupil must have been 
diagnosed and assessed by a locaJ special education 
team and be receiving special education services. 

No. The intention of the proficiency law is that 
pupils be assessed in elementary school so that 
pupils who are not progressing adequately toward 
proficiency in the basic skills can be identified 
early and provided with remedial instruction. The 
new amendment to the law requires that differen- 
tial standards may be provided only for pupils who 
meet both of the following criteria: 



*A recent amendment (AB 2(M3» Chapter 893» Statutes of 1978) to the proHcieney provisions of the 
Education Code dafifies the categoiy of pupUs for whom difTeienliai pxoHeiency standards may be provided. 
The answers to the questions concerning difTerenttal standards are elaborated in Appendbc L, "Setting 
Differential Standards,** distributed by the Department in December, 1978. 
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Question 



Answer 



K Enrollment in a special education program 
pursuant to Education Code Part 30 (com* 
mencing with Section 56000) 
and 

2. Possession of diagnosed learning handicaps or 
disabilities that would preclude their attaining 
the district's regular standards with appropri* 
ate educational services and support 

Any such differential standards must be included 
in the Individualized Education Program developed 
for the pupil pursuant to P^ 30 (commencing 
with Section 56000X In addition, the definition of 
pupils with diagnosed learning handicaps or dis- 
abilities is meant to be broadly construed and not 
limited to pupils identified pursuant to Education 
Code sections 56600, 56601, or 56302. 



Questions That Remain Unanswered 



May districts issue ^^alternative" diplomas (e.g., 
^^certificate of attendance") to students who fail 
to meet required proficiency standpxds? 



As was noted in the initial release of the Technical i 
Assistance Guide for Proficiency Assessment, the 
Attorney General was asked by the Legislature to 
provide an opinion on this question. The opinion 
was issued to Assemblyman Gary Hart on 
January 9, 1978. A full copy of the opinion 
appears on pages H4a-H4c, but the Attorney 
General's conclusion was as follows: 

While it IS probable that a court would uphold the 
authority of a school district to issue a certificate of 
completion under the circumstances you describe, sufH* 
cient doubt exists as to the intent of the Legislature as 
to suggest that legislative clarification is desirable be* 
cause of the impact of such uncertainty upon governing 
boards and upon affected pupils. 

In partial response to this opinion and in response 
to the Legislature's need for general information 
on the status of local implementation of new 
proficiency requirements, the Legislature will be 
scheduling an informational hearing in April, 1978. 
The hearing will allow county and district repre- 
sentatives to share their reactions to the Attorney 
GeneraPs opinion and to raise questions and issues 
related to implementation of proficiency 
requirements. 
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CvtLLC J- YoUNGtR STATE OF CALIFORNIA 




t>mCE OF THE ATTORSEY GENERAL 

Drpartmrnt nf Snstirr 

999 CA^ItOL MALI.. SUItC 39O 
ifi16i 449.9999 

January 9, 1978 



The Honorable Gary K- Hart 
Assemblyman^ 35th District 
State Capitol, Room 5136 
Sacramento, California 95814 

Re: CV 77/101 IL 



Dear Mr. Hart: 




You have requested an opinion on the following question: 



Does any existing provision of law preclude the governing 
board of any school district maintaining a high school after 
June of 1980 from conferring a certificate of completion, in 
lieu of a high school diploma, upon any pupil who has com- 
pleted the district's prescribed course of study, but has 
failed to meet the standards of proficiency in basic skills 
of the district? 



The conclusion is: 



While it is probable that a court would uphold the authority 
of a school district to issue a certificate of coit5)letion under 
the circumstances you describe, sufficient doubt exists as to 
the intent of the Legislature as to suggest that legislative 
clarification is desirable because of the impact of such uncer- 
tainty upon governing boards and upon affected pupils. 



ANALYSIS 



Education Code section 51225.5 provides, in part, that 
"...subsequent to June 1980, no pupil shall receive a diploma 
of graduation from high school who has not met the standards 
of proficiency in basic skills prescribed by the governing 
board. The governing board may adopt differential standards 
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The Honorable Gary Hart 
Page 2 



of proficiency in basic skills for pupils with diagnosed 
learning disabilities • • (All section references herein* 

after are to the Reorganized Education Code.) 

No existing provision of law expressly precludes the governing 
board of any school district maintaining a high school after 
June 1980 from conferring a certificate of completion in lieu 
of a high school diploma upon any pupil who has completed the 
district's prescribed course of study but who has failed to 
meet the standards of proficiency in basic skills established 
by the district. 

It could be argued that the language of section 51225«5 to the 
effect that "<<<no pupil shall receive a diploma of graduation 
• • - who has not met the standards of proficiency in basic 
skills < . .** implies that a pupil who does not meet such stan' 
dards fails to complete high school satisfactorily and^ 
therefore, that no diploma or certificate may be awarded which 
suggests to the contrary* 

But the language used by the Legislature certainly does not 
compel such a conclusion- It must be recalled that the Legis- 
lature recently added section 3S160 so as to provide that: 

**0n and after January 1, 1976 r the governing 
board of any school district may initiate and 
carry on any program, activityr or may otherwise 
act in any manner which is not in conflict with 
or inconsistent with, or preempted by, any law 
and which is not in conflict with the purposes 
for which school districts are established,** 

Since the "standards of proficiency in basic skills** which are 
required to be established by section S122S,S **includer but 
[are] not necessarily • • - limited tOr reading comprehension, 
writing, and computation skills * . . (to] enable individual 
achievement and ability to be ascertained and evaluated," it 
does appear that a valid distinction may be drawn between 
completing a district's prescribed course of study on the one 
handf yet failing to meet the standards of proficiency in 
basic skills on the other hand* 

To the extent that a certificate of completion does appear to 
have a substantive difference from a diploma of graduationr it 
is likely that a court would hold that section 3S160f supra , 
provides sufficient statutory authority so as to authorize a 
school district to issue such a certificate in lieu of a 
diploma. 
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Of further interest, however, is section 51410 which pro- 
vides in part that: 

•*No diploma, certificate or other document 
which is conferred upon a pupil as evidence of 
his completion of a prescribed course of study 
or training shall bear any distinctive marking 
or words which indicate that the pupil upon whom 
it was conferred was, for purposes of his course 
of study or training, placed within a particular 
classification based upon his intellectual or 
mental capacity. * * . ** 

To the extent that the reason for granting a certificate of 
completion is because a pupil has failed satisfactorily to 
qualify for a diploma of graduation, a strong argument can 
be advanced supporting the conclusion that a certificate of 
completion, issued for that reason, is so distinctive as to 
indicate a ''classif ication** of the student based upon his or 
her intellectual or mental capacity* 

This reasoning could compel a court to conclude that such a 
certificate would violate section 51410 and, therefore, the 
necessary statutory authorization to issue such a certificate 
could not be found in section 35160, supra * Equally clearly, 
however, the failure to grant a diploma of graduation has the 
same negative effect as the issuing of a certificate of com* 
pletion where the basis for such an act is the failure of the 
pupil to meet the district's standards of proficiency in basic 
skills. It is difficult to predict how a court would react to 
these interpretations in the absence of facts showing their 
impact upon affected pupils. 

While it is probable that a court would uphold the authority 
of a school district to issue a certificate of completion under 
the circumstances you describe r sufficient doubt exists as to 
the intent of the Legislature as to suggest that legislative 
clarification is desirable because of the impact of such un- 
certainty upon governing boards and upon affected pupils. 

We trust this brief expression of our views is of assistance to you. 
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The Meaning of Assessnnent of Basic Skills 
In Calilbrnia School Districts 



Assembly BUI 3408 is likely to have great impact 
on the design and management of instructional 
programs in Califomia^s public schools. It is hoped 
that by examining the intent of the legislation and 
the specific requirements of the law, districts will 
design proficiency standards and procedures to 
ensure that students graduate from high school 
proficient in basic skills. 

Assembly Bill 3408 was a direct response to the 
growing public perception that some students 
graduate from high school with insufficient com- 
munication and computation skills. The Legislature 
considered the fact that present graduation require- 
ments are most often based on "seat time." rather 
Jhan on any indication by students that they are 
'proficient in the basic skills. The Legislature also 
recognized that some students' learning styles 
could best be served by allowing the students to 
develop and test their abilities in a variety of 
settings outside the school and the classroom. 



Local Control and Responsibility 

The proficiency requirements added by AB 
3408 have the potential for enhancing the skills of 
students and the effectiveness of schools. However 
if the requirements are poorly implemented^ they 
can be of great harm. For example^ inadequate 
standards and assessment procedures could pro- 
mote "tracking" systems in which students become 
labeled. Unreasonable standards could become a 
punitive mechanism to discourage some students 
from continuing their education. 

It is especially important that districts ensure 
that proficiency standards and accompanying 
assessment and instructional procedures are care- 
fully coordinated with all phases of the instruc- 
tional program. In its technical assistance activities, 
the Department of Education will provide sugr 
Igestions that districts may incorporate in their 
implementation procedures. The Department of 
Education's role in implementing AB 3408 is not 
regulatory. Rather, materials produced by the 



Department, including this guide» are advisory and 
not meant to be prescriptive. 

Districts should recognize that AB 3408 does 
not prescribe a uniform set of proficiency stan- 
dards or assessment procedures for every district. 
The law is quite specific; it assigns each district the 
responsibility for establishing proficiency standards 
and related assessment procedures. 

The law goes beyond simply requiring that an 
assessment be made. Student progress in the basic 
skills must be determined periodically so that those 
students who do not meet district-prescribed pro- 
ficiency standards are identified eariy. Then school 
personnel must hold conferences with the students 
and their parents or guardians to identify indi* 
vidual problems and suggest actions that will help 
students reach the required levels of proficiency. 
How students are identified and how the district 
responds to the students^ learning needs are local 
responsibilities. Techniques of assessment must be^ 
without question^ an important outgrowth of this 
legislation. These techniques must have a direct 
relationship to the local courses of study. But the 
assessment techniques cannot be allowed to define 
or control the process through which each district 
determines and implements its proficiency stan* 
dards and procedures. 



Meaning of Minimum Standards 

One of the more perplexing questions posed by 
AB 3408 is this: What are minimum standards? 
Cteaily, the intent of the law is to require the 
establishment of credible^ measurable proficiency 
standards through which students demonstrate 
their skills in reading comprehension^ writings and 
computation. However^ this requirement alone 
provides little guidance as to the general level of 
skills the Legislature intended to be measured and 
documented. The Department believes that it is the 
intent of the law to have the standards relate to the 
kind and level of skills necessary for students to 
function effectively in society. Standards should be 
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established so that every student has a reasonable 
and realistiii opportunity to achieve the required 
level of proficiency and receive a diploma by the 
end of grad^ twelve. However, the law allows 
school districts to establish '"differential standards'' 
for tho!;e students with ''diagnosed learning dis- 
abilities/' 

It was the Legislature's intent to have districts 
make an early identification of students who may 
have problems in attaining certain levels of pro- 
ficiency. The law requires that students' skills be 
asse^ised periodically and that supplementary in- 
stmction be made available for those who need it. 
Tlh^ law also requires that the school, the student, 
and the student's parents be kept well informed of 
the student's progress toward meeting the required 
standards. Hie Department believes that AB 3408 
means that no i^tudent or group of students should 
be excluded from earning diplomas; rather, the law 
intends to have school districts motivate and assist 
all students to attain at least minimum proficiency 
in the basic skills. 

The law requires that through the assessment 
procedures each student's progress in achieving 
proficiency in the basic skills be measured; the law 
does not call for making comparisons of one 
student's achievement with group achievement or 
for contrasting the achievement of various groups 
of students. Specific recommendations regarding 
the assessment procedures are included in a later 
section of this guide. 



Need for Credibility 

If local proficiency standards are to be more 
than another educational "fad*' or ''panacea." they 
must be credible not only to educators but also to 
the students, parents, and communities that 
schools ser\e. This suggests that standards should 
be developed with community assistance and 
involvement. 

The credibility of district standards ought to be 
built within each community through an open and 
continuous process of consensus on the skills that 
students must have to function in adult life. Many 
of the suggestions included in this guide reflect the 
importance of having broad community involve- 
ment in the process, 

A district may choose to comply with the 
mandates of AB 3408 by adopting a set of 
reasonable proficiency standards, assessing student 
performance against those standards, and meeting 
the other provisions of this law. Some districts, on 



the other hand, may decide to see AB 3408 as a 
point of departure from which to move beyond the 
specific legal requirements toward, for example^ a 
competency-based instructional program. 

Because the law offers the opportunity to go 
beyond minimal compliance, the responses among 
districts are likely to vary. Comparisons among 
districts will inevitably be made. The law speci- 
fically provides for and encourages different local 
responses. If a district has established its pro- 
ficiency standards and procedures through a local 
process of dialogue and consensus, the district 
should fee! secure in the knowledge that its 
standards and procedures are useful and meaning- 
ful for its district and community. 

Major responsibility for successful implementa- 
tion of a basic skills assessment program will rest 
with the individual school site administrators. They 
must handle the details of administering the 
assessment program, interpreting the results, and 
planning any needed changes in curriculum. There- 
fore, districts should involve school site admin- 
istrators in all phases of their decision-making 
process. 



Major Logistical Challenge 

Development of proficiency standards^ assess^ 
ment procedures^ and supplementary instruction 
strategies by June, 1978, presents a major logistical 
challenge for most districts and school adminis- 
trators. Clearly, establishing such a system in a 
very short period of time could easily overload the 
administrative resources of even the ino$;t capable 
district. Therefore, districts that have not yet 
begun, or have begun oniy recently, to implement 
the provisionsof AB 3408 should start by adopting 
a limited number of requirements in each of the 
required skill areas for which they can develop 
manageable student testing and monitoring pro- 
cesses. As districts and their administrators gain 
more experience with these processes, additional 
requirements and assessment procedures can be 
easily added* 

The usefulness of a district's proficiency stan- 
dards depends largely on the credibility and feasi- 
bility of the assessment system. Having a broad 
base of participants involved in the decision- 
making process- board members, administrators, 
teachers, students, and parents -provides credi- 
bility; and when those involved clearly understand 
that the purpose of adopting proficiency standards 
is to improve the skills of students, the system 
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becomes feasible. It is important then to keep in 
mind that the more complex the array of profi- 
ctency assessment procedures a district adopts^ the 
more difficult it will be to foster an understanding 
of these procedures among the participants. 

The law makes no express provision for the 
State Board of Education or the Department of 



Education to monitor district implementation of 
AB 3408. However* the Legislature has indicated a 
desire to follow up and examine district responses 
to the law. How or by whom this monitoring will 
be carried out is unknown at this time, but it is 
likely that some statewide analysis of the impact of 
the law will be conducted in the future. 
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III. 

Guide for Inrplementing a Proficiency 
Assessment Program 



A proficiency assessment program has an impact 
on all aspects of a school district's operation, and 
the best way for a district to develop a sound and 
acceptable program is to examine the current 
curriculum and instructional programs after con- 
sidering the needs of the community. This section 
of the guide offers suggestions to sdiool districts 
for identifying basic skills, developing assessment 
procedures, and settingstandardsofproftciency.lt 
is divided into four main parts: 

t Getting Organized This part outlines major 
district and individual school tasks, and it 
offers suggestions for developing a manage- 
ment plan and getting the community 
involved. 

2. Fatting the Plan into Action, A step-by-step 
framework for implementing the new profi- 
ciency assessment plan is presented in this 
part. It begins with a discus^on of the goal 
setting process and concludes with a state* 
ment on evaluation. Two special features 
appear in this part of the guide-one on 
setting differential standards for students with 
diagnosed learning disabilities and one on 
assessing the proficiencies of limited English 
speaking and non-English speaking students. 

3. Working with the Assessment Data, This part 
includes a sample plan for reporting and 
recording assessment information; e*g*, test 
results and alternative instruction, 

< Reporting the Assessment Information. This 
part presents a discussion of district and 
individual school responsibilities for holding 
conferences with principals and teachers, par- 
ents, and pupils and for reporting to the 
school district governing board and the news 
media. 

The implications for internal sdiool organization, 
including counseling, staffmg, curriculum develop- 
ment, and supplementary instruction, wUl be dis- 
cussed in a future publication. 



Getting Organized 

Assessing student proficiencies in prescribed 
areas as a partial basis for granting high school 
diplomas is a new undertaking in most California 
school districts. The management of the pupU 
proficiency assessment process is critical to the 
development of a wellnje^gned management plan. 
The plan should make clear not only who wUl be 
involved but also when and how they will be 
involved. Of course, the responsibility for pro* 
viding overall direction through policy rests with 
the governing boards of school districts. 

All school districts in California are faced with 
the legal mandate requiring pupU proficiency assess- 
ment. The law states that after June, 1980, no 
student shall receive a diploma of graduation from 
high school who has not met the standards of 
proficiency in basic skills; and the law also applies 
to those students who graduate at the end of the 
1980 summer session. A wide range of options is 
available for determining the most appropriate 
response to the new law. Alternatives range from 
minimal compliance to the development of a 
complex system of assessment. 

Developing a Management Plan 

This section of the guide was designed to assist 
district and school site management personnel in 
identifying and organizing the key tasks that must 
be accomplished to meet the provisions of the new 
law. This section also suggests some factors that 
can be helpful in clarifying the tasks and calls 
attention to options that may be considered. The 
major management tasks include the following: 

District Tasks 

1 . Establishing a budget 

2. Reviewing courses of study to see that they 
meet the needs of students and include 
legally required subjects 

3. Setting standards of proficiency in basic 
skills 
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4, Setting differential standards of proficiency 
for students with diagnosed learning dis- 
abilities 

5, Deagning alternatives to the required 
course of study 

6, Providing information on graduation 
requirements to the public 

Individual School Tasks 

7, Measuring individual pupil progress at re- 
quired intervals 

8, Designing supplementary instruction for 
students who fail the proficiency test 

9, Developing procedures for holding con- 
ferences with students who are performing 
below minimum levels of proficiency and 



with the parents or guardians of those 
students 

10. Budgeting state funds that are available for 
notifying parents and students 

Before the m^or management tasks can be 
undertaken, they must be clearly and spedftcally 
defined. In the following outline the mandated 
tasks are defined, and the pertinent management 
considerations are identified. After reviewing what 
needs to be done, district and school adminis- 
trators can decide how, when, and by whom each 
task is to be accomplished. The administrators may 
also wish to consiilt Appendix I, which presents 
some sample management and operations plans 
that provide suggestions for management steps and 
timelines. 



Major Management Tasks 



District Tadcs 



Management ConsidefitioDS for the District 



L Establish a budget 



2. Review courses of study to see that they: 

a. Provide students with the skills and knowl* 
edge required for adult life. 

b. Prepare students for admission to colleges 
and universities. 

c- Provide for vocational training, 

d. Include English, American history, Ameri- 
can governments mathematics, science, 
physical education, the completion of 
which shall be a requirement for 
graduation. 



No state funds are provided to districts for the 
implementation of student proficiency assessment 
except for the costs of notifying parents or 
guardians of the need to meet to discuss the results 
of a student's individual assessment and his or her 
need for additional instruction in the basic skills. 

Current legislation places emphasis on the acqui* 
sition of skills and knowledge necessary for success 
in the world outside of high schooL Techniques 
should be considered that will tell the school 
whether its students are gaining the necessary skills 
in their high school program; e.g., interviewing 
employers of graduates^ sending questionnaires to 
former students. 

In prescribing separate courses of study, man* 
agers are cautioned to avoid the labeling and 
subsequent tracking of students. An alternative is 
to establish some courses required for all students 
while providing additional options for learners 
having particular career goals, such as admission to 
college or employment in a particular job. 

EMstricts should avoid establishing multiple sets 
of graduation requirements which could lead to a 
multiple diploma system; e,g., semester unit 
requirements, basic skill proficiencies, and so forth, 
EMplomas of graduation may not be differentiated 
on the basis of students* intellectual capacities. 
Standards of proficiency ^ould be related to 
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Maior Management Tasks (Continued) 



District Tttsks 



3, By June U 1978, set standards of proficiency 
in basic skills, including, but not necessarily 
limited to, reading comprehension, writing, and 
computation skills. The standards will be writ- 
ten so as to facilitate the assessment of 
individual achievement. 



4, May adopt differencial standards of proficiency 
in basic skills for pupils with diagnosed learning 
disabilities. 



5. Adopt alternative means for students to com- 
plete the prescribed course of study, which 
may include practical demonstrations of skills 
and competencies, work experience or other 
outside school experience, interdisciplinary 
study, independent study, and credit earned at 
a postsecondary institution. 



Management Conskleiitioim for tfie District 

designated courses, with demonstrated proficiency 
as a condition for receiving course credit. 

It is suggested that each district develop a master 
calendar of tasks that need to be accomplished. 
The calendar should specify the beginning date of 
the activity, the completion date, and the name of 
the person who will complete the activity. It may 
be wise to assign one administrator the responsi- 
bility for monitoring the activities to ensure that 
all work is proceeding in accordance with the plan. 

Managers are advised to limit initial activities to 
the development and assessment of significant 
skills in reading comprehension^ writing, and 
computation. 

After districts set their initial standards of 
proficiency, they may then wish to expand further 
the scope of their assessment to challenge even the 
most talented and motivated students. 

Overemphasizing the minimum requirements 
may provide the public with a distorted perception 
of what most students can achieve and are achiev- 
ing in the public schools. 

Differences in standards of proficiency between 
neighboring districts may be ^ cause of future 
problems. Conrniunication links should be main- 
tained with other districts within the geographic 
region. 

For implementation purposes, the defining of 
diagnosed learning disabilities is the responsibility 
of local school districts. However, definitions 
should not be in direct conflict with the Califomia 
Master Plan for Special Education and Public taw 
94-142. 

This requirement goes beyond the mere assess- 
ment of basic skills and provides districts the 
opportunities for innovation. Education and 
schooling are not synonymous, learning takes 
place in many different environments, and students 
^ould be provided with a wide nmge of alternative 
means for rompleting course requirements. Dis^ 
trict and school administrators are encouraged to 
con^der such alternatives as theses 

a. Independent study. Students can became 
involved in off<ampus activities under the 
general supervision of ^ teacher. The school 
still receives its a.d.a. credit for these 
students. 



b. Veysey progiams. Students are concurrently 
enrolled in high school and community col- 
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Major Management Tasks (Continued) 



District Tasks 



ConsklmtioQS for tbe District 



6. Make available to students^ parents or guard* 
ians, and the public the requirements for 
graduation and the specified alternative modes 
for completing the prescribed course of study. 



lege courses, and credits earned may be 
counted towards both the associate in arts 
degree and the high school diploma. 

c. Enrollment in a regional occupation prograiD 
or center (ROC/ROP). Students can enroll 
concurrently in a typical high school program 
and a regional occupational center or pro- 
gram. 

The development of alternatives requires dis- 
tricts and schools to plan, design, and adopt 
cutricular programs for students for whom the 
regular course of study is inappropriate. Such 
programs need to be developed cooperatively with 
parents, administrators, teachers, and students to 
make sure that the alternative instruction is educa* 
tionally sound and of direct relevance to the 
student and that it provides students with instruc* 
tion they need to meet the locally adopted 
proficiency standards. 

A plan for informing a district's many publics 
regarding graduation requirements and alternative 
means for the completion of those requirements is 
a major management responsibility. Appendix J 
contains a sample "note to students/' which may 
be used to explain the proEf^m to students within 
the district. Press releases, notices sent home with 
pupils, pupil handbooks, inservice activities for 
principals and teachers, and presentations to 
organizations should be used on a regular basis. Do 
not neglect providing information to parents of 
elementary age pupils, particularly those with 
chQdren in grades four through six. 

l>istricts that serve multiethnic populations 
should have materials prepared in the appropriate 
languages. 

Communjcatk>ns strategies should be designed 
to reach each public the district serves. Procedures 
that are effective in communicating with one 
segment of the community may not reach other 
important segments. 



tndividii^ School Tarics 



Management Comidentions for Scfaoob 



. Take appropriate steps to measure individual 
student progress toward proficiency in basic 
skills. Assessments ^ould be made once during 
the seventh through ninth grades and at least 
twice during the tenth through eleventh grades. 



It may be useful to formulate "enroute'^ objec- 
tives for program monitorir^ purposes. Planning 
appropriate interventions for students who do not 
appear to be making sufficient progress toward 
achieving proficiency can be aided by the early 
identification of such students. Parental support 
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M^or Management Tasks (Continued) 



Individual School Tasks 



Management Considefatiotis for Schools 



8. Plan to provide instruction in basic skills for 
students who do not meet the established 
proflciency standards. 



9. Develop written procedures for requesting a 
conference with the students and the parents 
or guardians of those students who are not 
meeting district-prescribed standards in basic 
skills. 

10. Budget state funds available for notifying 
parents and students of the need to meet to 
discuss the results of assessments and to plan 
ways of helping the students. Develop proce- 
dures for verifying costs incurred in notifying 
students and parents that the students are not 
meeting the adopted standards of proficiency. 



may be gained more readily if a child's problems 
axe identifled in the elementary grades and confer- 
ences are scheduled early to discuss the problems 
and to develop appropriate courses of action. 

It is critical to achieve curriculum coordination 
among the elementary schools whose graduates 
attend the same high school. It is equally impor- 
tant to involve representatives of the elementary 
school districts in developing the proficiency 
assessment standards for the high schooh. 

Schools with large numbers of students failing to 
meet proficiency standards may be faced withr 
management, school organization, curriculum, and 
staff development problems that need to be con* 
sidered in the planning process: 

a. It may be necessary to divert staff members 
from current assignments to teaching assign- 
ments in the basic skill areas. 

b. Many staff members may not have the train- 
ing or skills required to teach students at the 
remedial level. 

c. Schools entitled to special funding, such as 
Elementary and Secondary Education Act, 
Title 1, funds or educationally disadvantaged 
youth funds, may wish to consider appro- 
priating some of these funds to assist eligible 
students in achieving higher levels of 
proficiency. 

d. Additional funds may be required for pur- 
chasing materials and specialized equipment 
for teaching basic skills. 

To ensure effective communication with the 
community, districts should prepare written 
notices and conduct conferences in the appropriate 
language. 

Guidelines will be forthcoming to clarify the 
reimbursement procedures. In the meantime, dis- 
tricts should begin to develop cost verification 
procedures. 
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Initialing Community Involvement 

It is a basic tenet that the public schools belong 
to the people. A decision as critical as determining 
graduation requirements^ including proficiency 
standards, needs community involvement to ensure 
acceptance and support* 

The law does not specifically require the involve- 
ment of parents^ administrators, teachers^ and 
students in any process other than developing 
alternative means for students to complete the 
prescribed course of study* In fact, in planning for 
the implementation ot student proficiency assess- 
ment, it would be possible for a district to involve 
only its professional staff* However, this approach 
seems inadvisable, for communities are more prone 
to accept change in their school systems if they are 
not only informed but also involved in the process* 

Community involvement may be encouraged in 
many ways: interviewing community members, 
holding town hall or school site meetings, running 
advertisements in local newspapers or on television 
programs, and requesting write-in or call-in com- 
ments. In addition a school district may use more 
formal approaches such as sending questionnaires 
to the community or establishing advisory 
committees. 

Forming an advisory committee. One way of 
securing community input for a program is to form 
an advisory committee. The committee should 
represent all segments of the sciiuol community^ 
and such representation usually can be gained by 
having the governing board initiate requests for key 
persons to participate. The advisory committees 
should include representative teachers, students, 
counselors, administrators, parents, and com- 
munity persons from labor, business^ and industry. 

In forming such a committee^ consider not only 
those persons who currently serve the school as 
members of existing advisory groups but also those 
who have not been involved. Consider the various 
ethnic and socioeconomic groups in the population 
and employers who have a stake in the products of 
the school. Recent high school graduates^ espe- 
cially those holding entry level jobs^ provide other 
useful perspectives. Representation from the ele- 
mentary schools is essential. However, the size of 
any one committee should be kept small, pref- 
erably not more than 15 or 20 persons. 

Since the committee members may not have all 
the background and expertise needed in a specific 
area, it may be appropriate to invite other persons 
to furnish resource information. Committee 



members may also wish to meet with other small 
groups to secure further information* 

Outlining the role and function of the com- 
mittee. After selecting the members of the advisory 
committee^ the next step is to outline its role and 
function* Its various responsibilities may be (1) 
providing information; (2) identifying options; (3) 
recommending alternatives; and (4) reviewing and 
responding to decisions* 

A number of basic decisions must be made as 
districts begin to develop proficiency assessment 
standards* Advisory committees can help districts 
answer the questions that need to be answered to 
make such decisions; 

1 , What are basic skills? 

2, What is proficiency? 

3* How should proficiencies be assessed? 

4* How should standards be set? 

5, Where does curriculum need to be revised? 

Advisory committees can use a variety of 
methods to help districts answer these questions, 
including questionnaires and telephone surveys. 

Using questionnaires to gather information. 
Questionnaires provide an alternative to. or assis- 
tance for, the advisory committee approach and 
are especially suitable for gathering baseline infor- 
mation on community preferences* The answers 
given for 10 to 15 well-written questions could 
identify the levels of competency the community 
believes its high school graduates should achieve. 
Information from the questionnaire could then be 
integrated with information from the school staffs 
faculty, and student population* Materials to help 
districts develop such a questionnaire are contained 
in Appendix H, 

Putting the Plan into Action 

Implementing proficiency assessment begins 
with an examination of the district's educational 
philosophy and cuniculum. A planning process 
should follow in which the district intenelates its 
purposes of instruction and the cuniculum. A 
sequence of integrated cuniculum content depends 
upon the development of (I) a philosophy or 
statement of purpose from which goals are gener- 
ated; (2) objectives which enable staff to know 
what students are to learn and wluch activities 
provide appropriate experiences for student learn- 
ing; and (3) assessment instruments to provide 
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feedback regarding how much and how well the 
students have learned. 

Setting Goals and Achieving Consensus 

District goals should be developed or reviewed 
to ensure that the material covered in the assess- 
ment has been integrated into the curriculum. The 
goals should outline instructional scope and 
sequence so that districts can develop^ program 
objectives. 

The basic elements of the goal development- 
selection process follow: 

/. Goal criteria. Detennining and agreeing upon 
a set of goals, 

2, Statement development. Formulating the 
specific wording of the goal statements. This 
process can be one of revising a given set of 
statements or creating new statements. The 
key issues are who should be involved and 
how. 

3, Statement refinement. Compiling a usabie list 
of goals. 

4, Goal priority. Assigning a priority rating to 
each goal statement. 

5, Consensus, Obtaining flnal agreement on goal 
priorities. 

6, Adoption, Securing formal board acceptance 
of the goat statements. - 

S t udent attainment of certain levels of 
proficiency is a shared responsibility. The profes- 
sional staff must clearly state what students are to 
learn and provide adequate resources in a structure 
that will facilitate learning. The students must 
realize that they shoulder the responsibility for 
their own learning and must put forth the neces- 
sary effort. Parents must demonstrate a value for 
education and encourage their children to strive 
toward proficiency in the basic skills. 

Developing and Selecting Instructional Objectives 

While the educational philosophy and goals give 
direction to district instructional programs, the 
objectives state generally who is to learn what and 
under what conditions. The conditions may be 
categorically or individually defined. When stu- 
dents are taking a general course of study, all the 
students in the course may operate under similar 
conditions. A contrasting situation would occur 
when an individual is working on an independent 
study project. In addition to considering the 
typical elements of an objective when writing 
courses of study, staffs will want to consider 
whether the objectives have sufficient value, scope, 
and sensitivity to instruction: 



o Value, Proficiencies represent skills which the 
student can apply immediately upon 
graduation. 

o Scope, Proficiencies include previously 
learned skills and concepts. Each proficiency 
should be clearly defined, so that the sam- 
pling of learner attainments will result in a 
valid assessment of that person's skills. 

o Sensitivity to instruction. Proficiency assess- 
ment should be related to the course of study. 

Proficiency assessment may be related to spe- 
cific courses of study in three basic ways: 

/. Proficiency assessment may be designed to fit 
the course of study. The course of study 
would remain basically unchanged, and the 
proficiency assessment would be designed 
around the course of study and would occur 
at the end of instruction. 

2, The course of study may be designed to fit 
proficiency assessment. Assessment would 
occur at the end of instruction. 

3, The course of study and the proficiency 
assessment could be combined. Assessment 
would be conducted on an ongoing basis. 
Under such a plan successful completion of 
the course would ^Iso mean the student had 
attained the required level of proficiency. 

Contemporary schools serve a diverse student 
population. These students learn thrbugli different 
modes and respond to instruction in varying ways. 
It is expected that a school will provide alternative 
learning opportunities to students, as needed, to 
assist them in completing prescribed courses of 
study. Local districts should examine available 
school and community resources. By matching 
available instructional resources to proficiencies, 
school personnel may be better able to select 
appropriate means of instruction for particular 
students. 

Pupil assessment can identify learnings at a 
variety of levels. For example, one district may 
choose to assess only the knowledge that students 
have acquired while completing a course of study, 
while another district may assess the ability of 
students to ^ppiy learnings to understand or 
evaluate events which influence their lives. Since 
the ability to recall information does not mean 
that a student will be able to understand or 
evaluate that information, districts are encouraged 
to assess student learning at higher levels of 
cognitive functioning as well as assessing the 
student's knowledge base. For example, students 
may be able to use reading rules to say words that 
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appear on paper. At a higher level, the students 
may be able to answer questions about what they 
have read, A higher level still may be the ability to 
act on something they have read or to determine 
whether the passage conveys a message that is 
important or valuable to them. 

Developing a Rationale 

The district's rationale for requiring profi- 
ciencies in the basic skills will determine the 
standards or levels of proficiency to be required of 
its students. In other words, districts may choose a 
minimum level which requires students to demon- 
strate knowledge of the basic building blocks 
leading to future development of basic skills; or 
districts may choose a higlier level or standard 
which requires their students to demonstrate a 
level of proficiency in the basic skills equal to that 
of an adult successfully performing a simitar 
life-rote task. 

Defining Basic Skills 

A school district must arrive at its own defini- 
tion of basic skills to include at least reading 
comprehension, writing, and computation. Each 
district has the additional task of further defining 
these skills. For example, reading comprehension 
may be defined as a continuum of processes 
ranging from decoding words through critical 
thinking, A district will need to specify these 
processes and identify ones essential to ^'basic" 
reading comprehension. A district will also need to 
decide the context in which these reading processes 
will be assessed. 

In its most basic form, computation means being 
able to read, write, and comprehend numbers. 
Computation also involves manipulating numbers 
in order to perform mathematical operations as 
welt as using these operations in a variety of 
contexts, A district will need to decide which of 
these processes constitutes competency in 
computation. 

Defining competency in writing again involves 
identifying a continuum of processes from the 
mechanics of spelling through written composition. 
In each skill area a district will need to define the 
continuum of processes, decide upon the critical 
elements of '^minimum proficiency,^* and set rea- 
sonable standards for student performance. For 
further assistance in defining and decision making 
for each of the designated skills, please see the 
Resource Catalog in this guide. 



Defining Reasonable Expectations , 

Setting student' proficiency standards should be 
done with deliberation and care. District staffs 
need to consider the variety of expectations people 
bring to the process. Students have expectations 
based on their personal goals and aspirations which 
will be directly affected by whether or not they 
attain the proficiency levels set by the district. 

Various groups within the community have 
different expectations related to student profi- 
ciency. Future employers, such as business, indus- 
try, labor, and governmental agencies, want assur- 
ance that their future employees have acquired the 
basic skills. Colleges, universities, and trade and 
technical training centers can plan more effective 
courses of study if they have assurance that 
students coming to them are able to read with 
understanding, communicate effectively, and com- 
pute accurately. 

Two sources of information that a district will 
find useful in defining reasonable expectations are 
(1) information based upon general community 
expectations, including a review of literature 3nd 
national norms; and (2) information based upon 
local student performance data, including a review 
of local group testing, teacher information, and 
state assessment results. Ideally, a district will 
consider both sources in defining reasonable expec- 
tations of student performance. 

Determining Assessment Procedures 

Tests, structured observations, work samples, or 
other forms of instrumentation used to gather data 
on student proficiencieft can make up the district's 
assessment procedures. These assessment proce- 
dures provide the data from which judgments 
about student proficiency can be made. In some 
circumstances only one measure of student perfor- 
mance may be needed to verify a student^s level of 
proficiency. In other circumstances multiple 
measures of student performance may be necessary 
to verify the same proficiency. 

A concept that is embodied in the notion of 
'^student assessment** is this: Assessment results 
must be usable for preparing an appropriate 
instructional program for each student. 

It is of little value in educational program 
planning to know whether a student is relatively 
better than 36 percent of the students of a given 
^ge or grade level. It is of more value to know that 
a student has difficulty in computation because of 
a misunderstanding of place value. Accordingly, 
districts are encouraged to examine carefully the 
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I types of iostrmnents that they may develop or 
select to use in their proficiency assessment proce* 
duies. They should consider how useful the result- 
ing infonnation will be for planning educational 
activities, strategies, and individual programs for 
particular students. 

Selecting Assessment Items and Exercises 

The most typical assessment instrument is a 
multiple^hoice or true*false test. Ready avail- 
ability of computerized scoring services has made 
this format most attractive. It is also the most 
efficient way of getting a detailed analysis of 
student performance within a school, district, or 
state. It is most useful for questions requiring a 
fine line discrimination among dosely related 
options, only one of which is correct. For example, 
the student may be asked to select the serial 
number of a particular part from a listing of similar 
parts, all having the same number of digits in their 
senal numbers. However, using the multiple-choice 
or true-false test may not always be the most 
appropriate way to determine each individuaFs 
proficiency in the basic skills. The most accurate 
results are obtained from assessments based on 
more than just one method. 

In designing assessment procedures, school dis- 
tricts should examine the three basic models 
developed by the State Department of Education 
to be used for generating assessment items and 
exercises (see Appendix A): 

/. School context model This model has tradi- 
tionally been usec^ in schools. To assess 
computation, the student may be expected to 
solve addition problems presented in word or 
numeral form. Reading comprehension may 
be assessed by asking questions directly 
related to the content of a reading passage. 
Writing may be assessed by recognizing spell^ 
ing or punctuation errors or similar isolated 
aspects of writing. The student is asked to 
select the correct answer from a list of 
possible answers. 
2. Functional transfer model The functional 
model is used to assess whether students can 
transfer learning from the classroom to life 
situations. Functional proficiencies can be 
assessed in the school setting. For example, to 
assess addition, the student may be required 
to determine the balance owed on a billing 
invoice listing two or more item entries. 
Reading comprehension could be assessed by 
requiring the student to read a product label 
and then answer questions pertaining to the 



directions. Writing could be assessed by 
having the student write a letter requesting an 
employment application. 
J. Applied performance model This form of 
testing is currently receiving a great deal of 
attention, especially in the field of adult 
education. Applied performance tests are 
designed to measure proflciencies in the most 
direct manner possible. For example, to assess 
proficiency in computation, the student may 
be required to make correct change while 
operating a cash register in a local business. 
Common techniques used in the classroom can 
also be used as assessment items and exerdses. 
EHstricts may wish to include some of the follow- 
ing in their assessment procedures: (1) essay 
questions; (2) sentence completion; (3) matching 
items; (4) short answer; (5) computational prob- 
lems; (6) math story problems; (7) math-science 
formula problems; (8) problems involving editing 
or correcting mistakes in mechanics of expression; 
and (9) spelling tests requiring students to spell 
words correctly that have been presented orally. 

Making Enroute and Final Assessments 

The value of assessing student proficiency rests 
in making certain that individuals acquire the 
knowledge and skills they need to function effec- 
tively in contemporary society. Enroute assessment 
of student proficiencies serves to verify the stu- 
dents' current levels of proficiency and to monitor 
students' general learning progress. If it appears 
during enroute assessment that some students are 
not progressing at the proper rate, it is to their 
advantage to be identified early so that their 
instructional program can be modified. 

A special problem presents itself when assiessing 
the proficiencies of limited En^sh speaking (LES) 
and non^English- speaking (NES) students. If the 
enroute assessment is performed in English, the 
students will obviously perform poorly. An 
enroute assessment in the students' native language 
will more accurately reflect their true level of 
proficiency in basic skills. This also enables school 
districts to determine the appropriate instructional 
changes that need to be made for students with 
problems in the use of their native language. Such 
intervention should prepare students to pass the 
final assessment in EngUslL 

Students who pass the final assessment are ready 
for higher levels of learning. Such students might 
then be matched with a community college or 
work experience program which would meet their 
particular needs. 
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Proficiency Assessment for Limited English Speaking 
and Non-English Speaking Students 



One of the m^or concerns facing school 
districts when implementing the provisions of 
Assembly Bill 3408, as amended by AB 65, is 
the effect of these new laws on Umited 
English speaking (LES) and non^English 
speaking (NES) students. As amended. Educa- 
tion Code Section 51216 now reads, in part: 

. _ the governing board of each district . . . ^lall 
take appropriate steps to ensure that individual 
pupil progress towards proficiency tn basic skills is 
assessed in the En^ish language dining the 4th 
throu^ 6th grade experience, once during the 7th 
throu^ 9th grade experience, and twice during 

the 10th thiouf^ Itth grade experience 

Nothing in this section shall preclude any district 
from conductiiig an assessment of any pupil in 
En^ish and tn the nauve language of such pupil. 

In other words, the assessment of basic skills 
must be ^dnunistered in the English language, 
but it may also be administered in the 
students* native language. The implication is 
clear: in order to graduate from high school,' 
LES/ NES students will have to pass the final 
assessment of their proficiencies in the basic 
skills in the English language. However, 
enroute assessment may be conducted in the 
LES/NES students* native language. In addi* 
tion the eiux>ute assessment in the students* 
native language may be used to assess the 
students* level of English language fluency as 
weU^ 

SpeciaT Concerns for LES/NES Students 

Requiring LES/NES students to pass an 
English language basic skills assessment raises 
several concerns: 

• When LES/NES students are.faced with 
an exantination in the English language 
and the prospects of sure failure, they 
may simply drop out of school. 

• LES/NES students may be channeled 
into remedial programs, which could 
result in a return to tracking systems. 

• The goal of language maintenance or 
langtiage revitalization may be assigned a 
lower priority than the goal of passing 
the proficiency tests. 



* Communities with smaU numbers of 
LES/NES students may not have the 
resources or desire to provide these 
students with an equitable opportuiuty 
to prepare for the proficiency assess- 
ments in the English language. 

• Communities with large numbers of 
LES/NES students may set proficiency 
standards low to avoid the negative 
criticism their districts might receive by 
setting standards that large numbers of 
LES/NES students could not reach. 

In addition to the concerns just cited, 
current Wlingual programs are often modeled 
after, and therefore contain some of the 
negative characteristics of, the mainstream 
program. For example, LES/NES students are 
often misled or confused as to what their 
actual levels of performance and skills are. 
This happens easily because the students and 
those who are conconed with the students* 
progress may be preoccupied with the stu- 
dents* being able to pass courses and to 
graduate from schooL As a result, they may 
ne^ect to measure the students* actu^ level 
of education and skills development. 

Dombush and Massey, in their research in 
the San Francisco schools, discovered that 
contrary to some beliefs, poor and minority 
children are constantly being told that they 
are doing weU ^en they are not; that their 
work is satisfactory when it is not; and that 
they are progressing when they are not. Not 
only are the students deluded but so are their 
parents^ Consequently, the public often sees 
that minority and poor students with passing 
grades cannot function in work or college^ 

A Need for Defmitions 

The benchmarks for success in school— the 
indicators of progress or of achievement-have 
not been defined, made explicit, or com* 
municated to the limited En^fish speaking and 
no n-Engfish speaking students or their 
femilies* Not only are they not known by the 
students, they may not be generally known or 
agreed upon by the school district*s staff. ' 
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Often there are no specific goals for whidi 
both students and staff can be held account- 
able by the school community. Assessment of 
proficiency in the basic skills, as mandated by 
AB 3408 (and amended by AB 65), in concert 
with the definition of "exit criteria** man- 
dated by the Bilingual*Bicultural Act (AB 
1329) have the potential for providing such 
focus and accountability. Coordination and 
articulation of the two sets of criteria are 
essential so that the purposes of both legis- 
lative acts converge. 

Proflciency assessments in English may 
prove beneficial to limited and non-English 
speaking students. Some programs for these 
students have vaguely defmed goals, some- 
times even contradictory goals, and the stu- 
dents* progress and benefits from individual 
programs are difficult to measure or observe. 
However, well-developed proficiency assess- 
ments could provide the data needed for 
developing definite, clear objectives that 
would help provide form, purpose, and direc- 
tion to those bilingual programs that have not 
established sound objectives. This could be 
particularly true if the proficiency assess- 
ments identify the competencies students 
must have to function in the social, economic, 
vocational, and political spheres of the com- 
munity. The goals of these programs shouM 
be much broader than those represented by 
the proficiency tests, but the tests could 
provide a minimal core of goals. Continual 
and accurate feedback to the students and 
their parents on the students^ progress toward 
these goals is essential. 

Implementation PrcK^ures for Basic 
Skills Assessment 

Districts should use special care when 
planning their assessment procedures for LES/ 
NES students. If the assessment procedures 
are not well planned, the number of LES/NES 
students disqualified from graduation could 
increase. It is important that some baseline 
data be generated in the next two years. In 
this way, after their assessment programs are 
implemented, districts could determine any 
decrease or increase in the percentage of 
LES/NES students who do not remain in 



school long enough to graduate. In addition 
districts may wish to do the following: 

• Develop translated forms of the diagr 
nostic instruments for use in the enroute 
assessments. 

* Incorporate skills, content, and concepts 
of the proficiency examination into cur- 
rent bilingual and En^h as a second 
language (ESL) programs. This process 
should not dominate or displace the 
important goals of bilingual education. 
The skills contained in the proficiency 
tests should be a universal component of 
instruction. 

• Administer bOingual diagnostic tests to 
limited and non-English speaking stu* 
dents as early in school as possible; then 
administer them at subsequent intervals 
to measure student progress. 

• Begin instruction as soon as possible in 
the areas of need, as indicated for 
individual students by the diagnostic 
tests. 

* In the regular instructional program, use 
English vocabulary and language that is 
parallel to the language used in items in 
the proficiency test. For practice as well 
as for the purpose of assessing the 
interim progress of students, allow stu- 
dents to take English and translated tests 
which parallel the official proficiency 
tests- 

* Provide bilingual test proctors to help 
students understand key terms, phrases, 
and words. 

The preceding recommendations are com- 
patible with current bilingual education 
models. Early diagnosis in the students* domi* 
nant language should identify any discrep- 
ancies between the students* actual skill levels 
and those disclosed by the proficiency test. If 
discrepancies exist, the students can concen* 
trate on the skills in which they are found 
deficient, studying them in their dominant 
language while simultaneously learning the 
English language. Phrased another way, early 
diagnosis and remediation in the dominant 
language, accompanied by English instruction,. 
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are consistent vnth the principles of biUngual 
instruction^ as set forth in AB 1 329. 

Further Considefations for LES/NES 
Students 

Early diagnosis and remediation axe impor- 
tant because students will vary in the amount 
of preparation they will need to pass the 
proficiency tests. The amount of preparation 
time students need may vary, as follows: 

• Students who demonstrate proficiency 
at or above the standards of the test in 
their own language wiU probably require 
at least a yearns preparation in En^i^ 
instruction to pass the tests and function 
in model bilin^ial programs. 

• Students who do not demonstrate age- 
level expected skills in their native lan- 
guage will probably take longer to pass 
proficiency examinations in English than 
those who demonstrate expected skills. 
Even if some students speak a little 
English, their other basic skills may not 
develop as rapidly as they should while 
they are learning the new language. Their 
needs are for remediation in their domi- 
nant language and continued instruction 
in English. 

• Many ^panish-sumamed students who 
speak little, if any, Spanish and who 
would be diagnosed as below expected 
levels of proficiency are frequently 
foHnd in high school bilingual programs. 
It should not be forgotten ttiat their 
dominant language is English and that 
their primary language of instruction for 
remediation of their skills should be 
English. For these students instruction in 
the language of their heritage is for the 
purpose of revitalizing it^ But instruction 
in Spanish for the Spani^-sumamed 
student who is English dominant ^ould 
not, particularly at the outset, be 
expected to yield substantial gains in 
baac skill development. 

• Early diagnosis in the dominant language 
and continual attention to preparation in 
the skills to be tested would do much to 



counteract discouragement and pre- 
mature departure from school. 

Bilingual programs are different from tradi- 
tional remedial dasses in important ways. 
They include, or should include, students at 
all levels of ability. They can generate sup- 
portive and motivating feelings of community 
not possible in the typical remedial program. 
Moreover, because these programs deal with 
more than remediation of skills, skill develop- 
ment can be incorporated into a rich cur- 
ricular context of the students' cultural 
heritage. 

Conferences with Students and Parents 

Recently added Education Code Section 
S12I6 requires that a conference be arranged 
by the school for students who fail the 
proficiency tests. The principal or his or her 
delegate, a teacher who knows the student, 
the student, and the parent are required to be 
present The purpose of such a conference is 
to devise an educational plan for the student 
that will help that student reach the level of 
proficiency required by the district. Concern 
has been expressed by parents that they may 
not be able to understand the technical 
aspects of the discussion to participate effec- 
tively in the conference. Parents may also be 
concerned that they will not have the exper- 
tise to evaluate the appropriateness or quality 
of the educational plan designed by edu- 
cators. It is stron^y recommended that 
parents who so desire be permitted to bring to 
the conference someone whose knowledge of 
education they trust. Further, the educational 
plan should identify indicators of improve- 
ment in the deficient areas that both parents 
and students can observe at home. Tutorir^ 
assistance should be provided, and the stu- 
dents should be permitted to retake the 
proficiency tests when they believe they are 
ready. 

Bilti^al students will profit if graduation 
requirements are tied to bilingual program 
objectives. Additionally, the bilingual educa- 
tion program undoubtedly offers the best 
vehicle for LES/NES students to gain the skUls 
and knowledge to pass proficiency tests and 
to be assured of leaving school with at least 
minimal functional skills. 
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loping Assessimnt Ptocedutes 

ENstncts should be careful at the outset to 
develop reasonable assessment procedures that will 
not overextend the resources of the professional 
staff. For example, many small school districts will 
be restricted by the level of funding available for 
computer scoring or additional professional help. 

Because the test format and types of items will 
affect both scoring procedures and interpretations 
of flndings, a good ^^blueprint^* or set of instru- 
ment specifications is needed before beginning 
construction of an assessment instniment. When 
the instrument specifications are being prepared, it 
is advisable to include examples of desired item 
types and detailed descriptions of question and 
answer characteristics. As assessment items are 
developed, attention should be paid to the details 
of test analysis. To prevent errors and to verify the 
usefulness of the test specifications, the specifi- 
cations should be reviewed by those who will be 
writing the questions before test development 
begins. 

Districts interested in constructing their own 
instruments are encouraged to read carefully the 
material in appendixes A, B, C, and D. 

I Selecting Assessment Instruments 

Some school districts may prefer to select 
assessment instruments from among available 
resources rather than construct their own. Dif- 
ferent types of instruments are attractive to dis- 
tricts for varying reasons. However, regardless of the 
types of instruments a district decides to use, it is 
essential that those selected pertain directly to, and 
accurately assess, student performance in the local 
courses of study. 

Resources from which instruments may be 
selected are (1) norm-referenced measures accom- 
panied by a complete set of objectives the test was 
designed to measure ; (2) criterion-referenced 
instruments, with corresponding objectives speci* 
fled; (3) ^^pools^' of validated items which are 
matched to the test specifications prepared ty a 
district. However, regardless of the resources used, 
the test must assess student performance in the 
local curricula. 

No rm*re fere need and criterion-referenced mea- 
sures may differ widely or be identical in all 
important aspects except application. Both may 
have norms, may indicate a performance standard 
to verify mastery, and may have standardized 
administration and scoring procedures. 

The differences between norm-referenced and 
criterion-referenced measures have sometimes been 



exaggerated for purposes of illustration. School 
districts should remember that norm-referenced 
measures are developed for the purpose of relating 
an individuates performance on that instrument to 
the performance of others, the norming group. 
Conversely, criterion-referenced measures are devel- 
oped to determine whether an individual can 
perform acceptably when compared to a preestab- 
lisbed standard. 

Item pools are collections of items and exercises 
that have been constructed from instrument speci- 
fications. Districts that have specifications based 
on their learner objectives can match their specifi- 
cations with those for which items and exercises 
already have been prepared and ^^ooled.^* Items 
and exercises from the pool are then placed in an 
assessment format for administration. Ideally, each 
item and exercise that has been placed in the pool 
has been validated and accompanied by a statistical 
history of how well students have performed on it. 

Reviewing and Pretesting Assessment Procedures 

Before implementing a tryout, field test, or 
pretest of assessment procedures, the items and 
exercises and the mechanics of the assessment 
procedures should be thoroughly reviewed to 
detect errors ^nd faulty procedures (see Appendix 
C). The purpose of pretesting the assessment 
procedures are fourfold: 

1. To organize the distribution and collection of 
assessment materials so that all persons 
involved directly in the assessment process 
will have a firm understanding of their roles * 
and functions in the process and have the 
appropriate materials at the appropriate time 

2. To clarify directions for the administration of 
the assessment so that students have a clear 
understanding of how they are to respond to 
proficiency assessment items and exercises 

3. To identify faulty items and exercises so that 
they may be revised or eliminated from 
assessment procedures 

4. To gather student performance information 
that will enable districts to initially "set" 
reasonable passing levels on their proflciency 
standards 

The pretesting of proficiency assessment mea- 
sures should parallel or closely imitate the actual 
procedures planned. It follows that if student 
sampling is employed for pretesting, students 
selected should be representative of those students 
who will eventually be affected by the assessment 
procedures. 
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Assessment procedures should be continually 
reviewed and reflned* Such a review and reflne- 
ment process will hetp ensure the implementation 
of credible assessment procedures and will help 
detect and eliminate unfair biases. Assessment 
results will then be more usable and enabling to 
student growth rather than disabling and punitive. 

Safeguards and precautions are recommended 
for setting a good group testing situation (see 
Appendix D). These provisions include the counsel- 
ing and preparation of students for assessment as 
well as presenting the testing in a way that 
encourages each student *s best performance* 

Setting Standards of Proficiency 

Although setting standards of proficiency is a 
subjective process, the standards should not be set 
in an arbitrary or capricious manner* They should 
be based on data and set as responsibly as possible* 
It is a concern that students who have not attained 
the proficiency standards set by the district may be 
misclassifled as being proflcient and^ conversely, 
those pupils who have attained the proficiency 
standards of the district might be misclassifled as 
having not attained the standards* By utilizing the 
concepts of assessment as a process for making 
sound judgments based on data, misclassiflcation 
may be reduced* 

There is a legitimate concern that setting mini^ 
mum proflciency standards will result in lowered 
achievement becoming the encouraged and typical 
goal* This need not happen. The student assess- 
ment process can be established for all levels of 
student proficiency, not just the minimal skills 
level* Throughout all phases of schooling, students 
should be given information about their educa* 
tional growth* 

When student performance is measured against a 
standard, a school district can more easily deter- 
mine which students have and which students have 
not demonstrated proflciency* Because these stan- 
dards play an important role in determining which 
students are eligible to graduate, it is essential that 
they be set carefully* 

^When setting standards, districts should keep in 
mind that the expectations of the various school 
audiences may differ on the appropriate level of 
skill attainment* Proficiency standards should re- 
flect the concerns of various audiences* 

Students will be better motivated to achieve the 
prescribed standards if they are involved in setting 
the standards and have advance knowledge of what 
is expected of them* When disparity of expec* 
tations among the audiences exists and the stu- 



dents are aware of this disparity, the possibility of 
lowered student motivation exists* In addition 
there is the possibility of reduced support for the 
schools* programs by the different groups* Tliere- 
fore, it is important for districts to identify and 
understand the expectations of the audiences in 
their district before setting standards of student 
proflciency. 

Setting Differential Standards 

Local school district governing boards may set 
differential standards for students with diagnosed 
learning disabilities. By permitting local boards to 
set standards for students who have been diagnosed 
as having learning disabilities, several responsi- 
bilities are placed on local districts: 

1* Defining the term diagnosed learning dis- 
abilities consistent with the California Master 
Plan for Special Education 

2, Setting and justifying standards for learning 
disabled students which are different from the 
standards set for other students 

3, Complying with existing law, rules, and regu- 
lations which affect students who have partic- 
ular learning disabilities 

Defmitig a diagnosed learning disability. Diag- 
nosed learning disability is a clinical term used in 
special education. The term diagnosis implies an 
identification of causal factors which interfere with 
a student*s learning* The term disability implies a 
persistent and irreversible state. There is acknowl- 
edged difficulty in differentiating between the 
student who has difficulty learning and the learning 
disabled child* 

The assessment of students with diagnosed 
learning disabilities should be diagnostic and indi- 
vidualized* When the students' proficiencies are 
assessed, such variables as previous educational 
progress and methods of instruction, student 
ability, and total school behavior should be exam- 
ined to determine how better to assist the students 
to learn* An instructional plan that includes 
socialization instruction and vocational planning 
should be prepared as a result of the assessment* 

Some students initially diagnosed as learning 
disabled have learning problems which are subject 
to change. For example, the neurological develop- 
ment of children varies* Students experiencing 
delayed development often require different 
instructional procedures, but the uneven growth 
pattern may not necessarily have a lasting, dis- 
abling effect on the students* Appropriate instruc- 
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tional modifications should enable such students to 
adapt and develop as their abilities evolve. As the 
students mature, the leanung difficulties may 
diminish, allowing the students to function ade- 
quately without further supplemental instruction. 

tocal school boards can influence the student 
appraisal process in their districts through their 
definition of diagnosed learning disability. This 
guide encourages the use of a defmition which is 
consistent with the California Master Plan for 
Special Education. 

Setting differential standards for learning dis- 
abled students, Setting differential standards is a 
potential^ sensitive practice. It is important that 
the various school publics understand how any 
student will be classified as haying a learning 
disability. They must also understand the process 
that will be employed to set proficiency standards 
for the student having a diagnosed learning dis- 
ability. If these two processes are not thoroughly 
understood, some may consider the local governing 
board to be acting in an arbitrary and capricious 
manner. 

The process for identifying students who have 
learning disabilities is described in existing laws, 
rules, and regulations. The California Master Plan 
for Special Education is relatively clear in this 
regard.' It is recommended that the district com- 
mittee which has responsibility to develop an 
individual student's plan also describe the perfor- 
mance standards in basic skills for which the 
student may receive a diploma. 

It should be reemphasized that assessment of 
student performance may be based on multiple 
criteria, not just a test score. Committee members 
responsible for developing individual education 
plans should understand the definition of the term 
assessment as used in this guide. For each student, 
the committee should prescribe attainable stan- 
dards which enhance learning. 

It is recommended that student proficiency 
standards for learning disabled students be individ- 
ually set rather than set for the group as a whole. 

Complying with laws and regulations which 
affect learning disabled students. Existing law 
related to students having diagnosed learning dis- 
abilities encourages district personnel to use appro- 
priate resources to assist these students to achieve 
their potential. The philosophy contained in this 
guide is consistent with that view. 

Evaluating Proficiency Assessment 

School districts will need to determine the 
long-range effectiveness of their proficiency assess- 



ment. FolloWHip studies of students who have 
earned a high school diploma will: 

1. Identify the strengths and weaknesses of the 
educational program. 

2. Illustrate how well graduates perform in adult 
society. 

3. Suggest areas in which curriculum may need 
to be modified. 

Complete discussions of the broad areas of 
curriculum reform and proficiency assessment eval- 
uation are beyond the scope and design of this 
guide, but those areas will be treated in future 
publications* 

Working with the Assessment Data 

A student proficiency assessment system will 
produce information school audiences will need to 
know. Students will need to know how well they 
are progressing. Parents and teachers will need to 
know the information so that they can give 
assistance to students who need the help. Local 
school district governing boards will need assess* 
ment information in reviewing the effects of 
policies. Staff at all levels will need assessment 
information to revise curricula. 

Presenting assessment information to various 
audiences is a matter that warrants careful atten- 
tion. Districts and schools should consider which 
audiences will request assessment information and 
determine in what detail and form the information 
can best be communicated. 

Districts should develop a plan which shows 
what information will be kept, by whom, and to 
whom it will be reported (see the accompanying 
sample plan entitled the Overall Plan for Managing 
Student Assessment Information). 

The assessment process should enable principals 
and teachers to identify students who are not 
likely to attain the district-prescribed standards in 
the basic skills. Education Code Section 51216 
requires assessment of student progress toward 
proficiency in the basic skills at least once in grades 
seven through nine, and at least twice in grades ten 
through eleven. 

The use of data from student proficiency assess- 
ments will vary from district to district. Some 
districts ^will choose only to record whether or not 
students attained the prescribed proficiency stan- 
dards for graduation. Other districts, in addition, 
may choose to use the data to monitor student 
progress, validate assessment instruments and 
procedures, and evaluate curriculum adequacy. 
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Overall Plan for Managing Pupil Assessment Information 



Topic 



InfMinatiaii to be reported (to) 



Student 



Commumty and 
school board 



Recordkeeping (by) 



Teadtefs 



Prince's des^nee; 
e.g^ counselor 



ttor 



Standards of 
proBciency 



1^ Content of law 
2. Skill aceas to be 

coveted 
3* Proficiency levels 



1^ Content oflaw 

2. SkUl areas to be 
covered 

3. Proficiency levels 



L Content of taw 

2. SkUl areas tobe 
covered 

3. Proficiency levels 



h Monitoring of each 
student's progress in 
reaching required 
levels of proficiency 



L Standards to be 
covered in each 
department and 
course 

2. Students who have 
and have not 
attained proficiency 
levels 

3* Students on special 
projects 



K Criteria for profi- 
ciency assessment 

2* Proficiencies to be 
included 



Assessments 



4. Frequency 

5. Date and time 

6. Individual results 



4. Frequency 

5. Date and time 

6* Individual results 



4, Frequency 

5, Date and tinrte 

6, Group results 



2, Methods of 
evaluation 

3, Specific date and 
time 

4, Results 



4. Methods of assess* 
ment 

5. Individual student 
results 



3. Monitoring of all 
assessments 

4, Statistical data for 
schools and districts 



Conferences 



7. Notification of 

conference 
8* Status 

9. Identification of 
alternatives 



7* Letter announcing 

ccmfeience 
8* FoUow-^p tele* 

phone call 



7. Formative and sum- 
mative data on 
conferences 

8* Student and parent 
reaction 



Participation in 
conferences 



6. File copy of confer- 
ence iK>tificati(nis 

7. Follow-up phone 
calls 

8, Date and time of 
conferences 

9, File copies of deci- 
sions made at confer- 
ences, including 
alternative courses 
selected 

10* Spcdal projects 



5. Verification or com- 
pliance 

6* Provi^ons for alter- 
natives 



Instructional 

processes; 

alternatives 



10* Courses available 
IL Alternatives avail- 
able 



9. Courses available 

10. Alternatives avail* 
able 



9, Courses available 
10* Alternatives avail- 
able 



6* Standards to be 

covered in their 

course and department 
7* Course alternatives 



CIS 



11* Standards to be 
covered in each 
course and depart- 
ment 

12* Students on special 

projects 
13* Alternatives to 

regular program 



7. Courses of study 
and alternatives 



Limited resources available to districts will 
necessarily impose some restrictions* The hand 
recording of data will be the best approach in some 
small school districts, while computer4)ased moni* 
toring as^tance will be appropriate for others. 
Samples of fc^ms that have been helpful to 
districts in recording proficiency assessment data 
appear in Appendix E. 

Reporting the Assessment Information 

Assessment results will be useful to students, 
parents or guardians, and teachers for following the 
students* progress in skill attainment and to 
teachers, administrators, and school board mem- 
bers in analyzing curriculum^ 

If students are not meeting district*pres(Tibed 
standards in the basic skills, school personnel are 
obligated by law to inform the students and their 
parents or guardians of this fact 

It may be useful for school districts to design a 
sin^e recordkeeping system for keeping track of 
the conferences held with parents and students. A 
sample form that districts may modify for their 
own use may be found in Appendix F. 

Infoimiiig the Governing Board 

Local school district governing boards have the 
responsibility for establishing policies that result in 
hi£^ quality instruction in their districts. School 
administrators should present timely information 
regarding results of student proficiency assessments 
for use by board members in making policy 
decisions. Those responsible for curriculum imple- 
mentation in the district should be prepared to 
explain fluctuations or irregularities in the data. 

Infoiming the Public 

Providing proficiency assessment information to 
the various publics that a district serves is of 
paramount importance. The public should be kept 
informed of aJI significant developments. Lack of 
information or, even worse, misinformation will 
impede the successful implementation of a dis- 
trict's assessment procedures. 

Reporters and news editors will decide what 
information they will present to their readers, 
viewers^ and listeners. Therefore, it serves the 
district's interest to provide information which Htls 
the news media's needs and specifications. The 
news media may be most interested in : 

• How assessing proficiencies will affect the 
students' experiences 



• How proficiency assessment benefits students 

• What makes this a new program 

• What the new law requires of parents 

• How much the imfriementation of assessment 
procedures will cost 

The news media which serve the community in a 
district often serve the communities of other 
districts. The greater the number of school district 
communities the media cover, the greater the 
problem of reporting accurately and thorou^ily 
how each district in the area will implement 
assessment procedures. 

Since the law provides for each district to adopt 
its own standards of proficiency, these standards 
are likely to vary, even among neighboring dis- 
tricts. The public will probably question this. It is 
(Titically important that districts be able to explain 
that each district establishes standards based on 
local needs and goals, whidi vary from district to 
district. 

Contactii^ the News Media 

To establish good relations with the news media, 
provide all news media services with equal infor* 
mation and contacts, preferably all at the same 
time. If some of the media cover other schools or 
districts, arrange for coordination so that the 
reporters and editors are not deluged with the same 
information^ 

Consider coordinating all information that per* 
tains to all districts through one person, preferably 
a school public information specialist. Each dis- 
trict, however, must contact the news media on its 
own to release information that is unktue to that 
district. If the district does not have a school 
public relations specialist, consider asking someone 
with experience and an interest in news media, 
either staff person or citizen volunteer, to coordi* 
nate information on proficiency assessment and 
other newsworthy activities. The media contact 
person should: 

1- Offer to meet personally with the reporter or 
news editor of the local newspapers and the 
radio and television stations. Explain briefly 
the impact of proficiency assessment on local 
students and parents. 

2. Provide each news medium with a copy of the 
"Background Information" sheet and the 
district's version of one of the sample news 
releases (see Appendix G). News releases 
^ould be typed double spaced to allow for 
editorial revisions. 
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3* Review with the reporters or news editors the 
implementation efforts the district will be 
taking; then ask at what points they want 
information provided. 

4. Ask radio and television stations if there are 
interview shows or talk shows which would 
lend themselves to a discussion of assessing 
basic skills. 

5. If the reporters or news editors offer sugges- 
tions on how to make the information more 
newsworthy or more interesting, follow their 
suggestions. Each may have different require- 
ments. Furthermore, because they know their 
audience, following their suggestions will 
probably result in greater coverage* 

6. Suggest taking a picture of students being 
assessed. Most news and photo desks will 
prefer to take their own pictures, but if they 
ask you to provide one, it should be a black 
and white glossy (unless they specifically 
request color); 8 x 10 inches; the subjects 
should be close enough to show their facial 
features; the subjects should be actively 
engaged in testing, not posing or looking at 
the camera. If individual students can be 
identified, those students* parents should sign 
a photographic release form before the photo- 
graphs are submitted for publication. 

7. Offer to make available several students for an 
interview after they are assessed if it would 
interest the reporter or editor. 

8. If reporters or editors come up with ideas for 
a feature story, cooperate as fully as possible 



by providing the services and information 
needed to fulfill their requests. 

News is generaUy made up of actions or occur- 
rences, rather than of concepts. Therefore, the 
news media probably will not be interested until 
specific things happen regarding implementation of 
assessment procedures in the district, such as the 
following: 

1 . When school begins, the news media will be 
interested in a general description of the 
proficiency tests aiul what happens if students 
fail. 

2. When the school district governing board 
plans to adopt recommended standards of 
proficiency, the news media may want to 
report the upcoming meeting. 

3. When basic skills are being assessed, the news 
media will be interested in the results, such as 
the percent of students who pass. 

4. When the school district governing board 
adopts special programs to assist students who 
failed the assessment, the news media may be 
interested in the content of the programs. 

5. When the school district governing board 
adopts alternative means for students to fulfill 
graduation requirements, the news media niay 
want to know what the alternatives are. 

Three sample news releases are provided in 
Appendix G. The first is background information 
produced for the reporter or editor. The second is 
a sample news release for print media, and the 
third is a sample news release for the electronic 
media. 
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A Sample Assessment Exercises Manuals 



When the Technical Assistance Guide for Profi- 
ciency Assessment was first published in 1977, the 
Department planned to add sample assessment 
items as Appendix A C^Sample Assessment Exer- 
cises and Test Questions"). However, after the 
development of the sample items had begun^ it 
became apparent that the quantity of material 
necessary to provide an adequate range of assess- 
ment items with accompanying item specifications 
and performance statistics could not be accom- 
modated in the space available in the Technical 
Assistance Guide. As a result, the Department 
produced four additional volumes, the elementary 
and secondary editions of Sample Assessment 
Exercises Manual for Proficiency Assessment 
(SAEM). volumes I and IL Volume I contains the 
item deifications and sample assessment items. 
Volume II contains statistics that indicate how 
"snidents in grades four and sax (elementary edi- 
tion) and grades seven, nine, and eleven (secondary 
edition) performed on those items. 

In Volume I of the Sample Assessment Exercises 
Manual, items are presented in the following 
models: the school context model and functional 
transfer model in the elementary edition and the 
school context modeU functional transfer model, 
and applied performance model in the secondary 
edition. In both editions the school context model 
is divided into sections on reading, writing, and 
math. The school context model has traditionally 
been used in the school setting to test disa^te 
skills in isolation. This model is in contrast to the 
functional transfer and applied performance 
models, which may be used to test two or more 
skills simultaneously. Therefore^ depending on how 
a district designs its assessment, appropriate items 
may be selected from any single model or from a 
combination of models- The curricular emphasis in 
most schools, however, is currently more "aligned*' 
with the school context model than with the 
functional transfer model or applied performance 
model. For additional information on each of these 
models, the reader i$ encouraged to read in Volume 



I of SAEM the narrative preceding the sample 
items in each category and the section entitled 
"How to Use SAEM/' 

'In Volume II of the Sample Assessment Exer- 
cises Manual are sections on field testing, use of 
item statistics, and item statistics for the multiple- 
choice items in Volume I. The item specifications 
and items (Volume I) and the item statistics 
(Volume II) should be used together to create or 
select those items best suited to a district's 
assessment plan. Volume I of the elementary 
edition also contains a section on test construction 
and the curricular implications of proficiency 
assessment 

The Sample Assessment Exercises Manuals were 
developed to aid districts in designing an instru- 
ment to assess proficiency in the basic skills. If a 
district_ decides to use the item$ included in the 
appropriate manual, the items and procedures may 
be used as presented or altered to fit the needs of 
the district. The manuals have been distributed to 
all offices of county superintendents of schools 
and to all school districts; however, a limited 
number of additional copies are available and can 
be purchased at cost ($54 for volumes I and II of 
either the elementary edition or the secondary 
edition) by contacting: 

Bureau of Publications 

Califomia State Department of Education 

KO, Box 271 

SaCTamento,CA 95802 

(916) 445-1260 

The contents of volumes I and II of the 
elementary and secondary editions of the Sample 
Assessment Exercises Manual are listed below. 

Elementary Edition 
Volume I— Sample Exercises 

• Introduction 

Legal Requirements 

Technical Assistance to Districts 
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• HowtoUseSAEM 

Volume I of SAEM 
Volume II of SAEM 
Questions and Answers 

• School Context Model 

Development of Item Specilications 
Development of Sample Items 
Lisiing of School Context Model Skills, by Category 
and Page Number 

• Reading 

Development of Reading Passages 
Organization of the Specifications and Items 
Reading Passages 

• Writing 

Written Expression-Objective Measurement 

Spelling Word Lists 

Writing Samples- Direct Measurement 
Selecting the Type of Writing to Measure 
Pteparing Writing '^Prompts" for the Pupils 
Developing Scoring Guides 
Combining the Scoring Approaches 
Training Readers to Score Essays 
Writing Exercise-Expressive Essay 
Writing Exercise-Explanatory Ess^ 
Writing Exercise-Persuasive Essay . _ 

• Mathematics 

Organization of the Item Specifications and Sample 
Items 

Advisory p^ls 

• Functional Transfer Model 

Organization of the Item Specifications and Sample 

Items 
Task KO 
Task 2,0 
Task 3,0 
Task 4,0 
Task 5,0 

Advisory Panels 

• Text Construction and Curricular Implications 

Step 1 : Identifying Skill Areas for the Test 
Step 2: Constructing Item Specifications 
Step 3: Constructing or Selecting Items 
Step 4: Field-Testing the Items 

Pilot-Testing 
Field-Testing 

DetermiiungTest Reliability 
Selected References on Reliability 



Step 5; Using Test Results 

Level I-Individual Results 

Level 2-Group Results, by Content Area 

Level 3-Group Results Across Content Areas 



List of Figures 

State Department of Education Technical 
Assistance Materials 

Layout of Reading Item Specification and 
Definition of Terms 

Layout of Written Expression Item Specifica- 
tion and Definition of Terms 
Kinneavy's Categories of Discourse 
Summary Sheet for Analytic Sconng 
Summary Sheet for Analytic Scoring 
Summary Sheet for Analytic Scoring 
Layout of Mathematics Item Specification 
and Definition of Terms 
Sample Item Specification 



List of Charts 

Chart 1* Holistic Scoring Guide, Pen Pal 
Chart 2. Analytic Scoring Guide, Pen Pal 
Chart 3, Holistic Scoring Guide, Spaceman 
Chart 4,^alyUc Scoring Gjnde^ 
Chait 5, Holistic Scoring Guide, Field Trip 
Chart 6, Analytic Scoring Guide* Field Trip 
Chart 7, Levels of Review of Test Results 



Volume Il-Item Statistics for Grades 4 and 6 
The Field Test 

How to Read the hem Statistics 

Districts Participating in the Proficiency Field Test 
Reading 

Written Expression 
Mathematics 
Functional Transfer 



Figure 


1, 


Figure 


2, 


Figure 


3, 


Figure 


4, 


Figure 


5, 


Figure 


6, 


Figure 


7, 


Figure 


8, 


Figure 


9, 


Figure 


10, 



Secondary Edition 
Volume I'Sample Exercises 

* Introduction 

Legal Requirements 

Technical Assistance to Districts 

« How to Use SAEM 

• School Context Model 

Development of the Item Specifications 
Development of the Sample Items 
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listing of School Context Model Skills, by Category 

and Number 
Reading 
Writing 

Written Expression-Objective Measurement 
Mating Samples-Direct Measurement 

Mathematics 
Advisoiy Panels 

Functional Tnmsfer Model 
Applied Ferfonnance Model 

An Introduction to Applied Performance Tests 
(APT^) 

Examples of Three Modes of APTs 
Vocational Education 



Volume n-Item Statistics for Grades 
7, 9, and II 

e Introduction 

e HowtoUse£40f 

• The Fiteld Test 

e How to Read the Item Statistics 

IMstricts P^cipatmg in the Field Test 

• Reading Statistics 

e Written Expression Statistics 

e Math Statistics 

e Functional Transfer Statistics 
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Proficierxy Assessment Pequifements 
in California: A Status Report 



The 1979 edition of Tedinwal Assistance Gidde for PmfU:iency Assessment yn^xo include as Appendix 
B a report on the status of proficiency assessment in Califomia. That report, however, is being published as 
a separate document, /intp/emenjs^ljofi of^Pmfi€kncyAsmsm€ntReqmt€memsofAB340Sf76andAB 
65177: A Status Reports Copies of the report are available from Bureau of Publications, California State 
Department of Education, P.O. Box 271, Sacramento, OA 95802; (916) 445-1260. 
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Appendix 



c Guidelines for Editing Test Items 



In preparing or selecting test items to be used for 
proficiency assessment, school districts should judge the 
adequacy and appropriateness of the items they plan to use, 
and they should examme the mechanical features of the 
test* This appendix was prepared by the Department of 
Education as a guide for school districts to use tn their 
item selection and test review process. 



Selecting and Reviewing Items 

A number of criteria can be used to judge the adequacy 
of test items. However, rather than describing all these 
criteria, a few baste rules are presented here for school 
districts to consider in screening out or conecting inade* 
quate items: 

L Multiple-choice and true-false items should have a 
single best answer* When two or more answers are 
equally pbusible, the item should be revised or 
eliminated from the item data bank. An example of an 
item without a single best answer follows: 

Otoose the correct punctuation mark that belongs at 
fhe end of each sentence: 

We are going to the park 

A. Period 

B, Question mark 

C Exclamation mark 

Although a period may be the end punctuation 
mark that a person would be expected to use most 
often with this sentence, the stem (sentence) could be 
correctly interpreted as an intenogatory or exclamatory 
sentence* Without a more specific context, any of ttie 
punctuation marks could be correct. To improve the 
item tn the example, it could be reworded as follows: 

Are we going to the park 
A. Period 
A Question mark 
C Exclamation mark 

2* Multiple-choice and true-false items should require the 
student to make meaningful discriminations. All the 
distractors (incorrect responses) should be plausible or 
appealing to those students who do not possess the 
knowledge demanded by the item. Items with trivial or 
unrealistic distractors should be revised or omitted 



from the item data bank. An example of an item 
illustrating the problem follows: 

Pnor to 1066 the common langu^e in 
En0and Mm Old En^isk Whidt of the following 
peoples had contributed to this language? 

A. Celts 

B. Chinese 
C Mexicarts 
D. Indians 

This item could be improved in the following way: 

Prior to 1066 the common language in 
England Old En^ish* to which all of the 
following peoples had contributed except: 

A. Celts 

B. Danes 

C An^oSaxons 
D. Normarts 

Note that all the alternative answers now are 
equally plausible to students who have a general 
knowledge but are not familiar with the dates various 
national groups migrated to England. 

The length of the distractors in a multiple-choice test 
item should be comparable and gramatically parallel 
to the correct response* Items with response altema* 
lives that are not comparable should be revised 
Of omitted* Two examples of this type of enor 
follow: 

Prior /o 1066 the common language in 
England was Old En^ishy to which cdl of the 
following peoples had contributed except: 

A. Celts 

B, Danes 

C An^oSaxons 

D, The Normans hAo migrated from France 

In this case, the length of the distractor is a cue as 
to the correct answer. The secorKl example illustrates 
less subtle cues, which can unintentionally work thtir 
way into distractors: 

Whkh of the following is a chemical change? 

A. fee dutnging into water 

B. Water charting into ice 

C Paper burning and changing into ash 
D, Water changing into steam 
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The above item has two signincant weaknesses: 

a. The incorrect distractors deal with processes 
associated with water while the correct answer 
addiesses itself to an entirely difTerent sub* 
stance and process, 

b. The conect answer is slightly longer but also 
involves two process words (Le*, burning and 
changing) while the distractors have a single 
process word and are shorter* 

As this item stands^ testwise students wtU probably 
be able to identify the conect response whether or not 
they know the subject matter* The above item could be 
improved by modifying the item In the following way: 

Which of the foliomng invoh^ a chemiad 
changeT 

A. Muring 

B, Freezing 
C Burning 

A Evaporatif^ 

4* The use of specific determiners siiould be avoided (i^*^ 
words often found in false statements "only^ never* 
ali^ every^ always* none* and no"; and in true state- 
ments the words are "Visually* generally* sometimesi 
ciistomarily* often* could^ and fiequently**' Test items 
containing specific determiners should be revised if the 
determiners direct the student to the correct response* 
An item illustrating this type of error follows: 

When the Temperature of a ggs is increased. 

i4* the pressure aiwttys irwreases^ 

B. the vahime dtmys decreases. 

C* the pressure depends on the volume. 

O. the kinetic energy tdway% changes. 

E. the vohtme never changes. 

Students familiar with the aiways-never type of dis- 
tractor could easily identify item C as the desired 
response^ even though they mi^t not know the gas 
laws* 

5* A completion-type test item should use a relatively 
small number of well-chosen blanks placed near fhe 
end of the statement* An item that has so many blanks 
that it is unintelligible should be revised or omitted* 
The following item is illustrative of that type of error: 

is a tissue ^ft^^tr mi!!iimtre thick. 

If this item were intended to measure knowledge 
about human skin tissue* there are not enou^ signif* 
icant cues to indicate clearly to the student the 
content area for a coriect response* This short answer 
completion-t^ item could be improved in the follow* 
ing way: 

Human skin ^ o tissue about miHi- 

metrefs} thick. 

Note the inchision of (s) after millimetre so as not 
to cue the response to one millimetre or less* 



6* Items siiould be related to meaningful leaining goals^B 
An item assessing trivial content or peripheral content 
should be revised or omitted from the item data hank* 
Consider the following example: 

Which of the following presidents of jhe 
UnitedStateshadwodenfi^ teeth? 

A. Washington 

B. Harding 
C Homer 

D. Truman 

E. Nixon 

7* Items should contain content ^i^ch represents a 
comparable task for all students; Le** items should not 
contain content oriented toward a particular segment 
of a student population* sex* or ethnic group* 

S. An item and its distractors should be so worded that 
their whole content functions in determining the an- 
swer, rather than depending on a key word* phrasei or 
part of the item to elicit a particular response from 
the student* The following item is illustrative of this 
problem: 

A general in the Civil War who became 
President of the United States was: 

A. Jefferson 

B. Adams 
C Grant 
D. Hoover 
E Nixon 

In this situation* a student able to identify Grant 
as the oniy ^neial on the list can correctly answer the 
item without making the discriminations seemingly 
required to answer the item* However^ such a gross 
level of discrimination may be a desired learning 
outcome goal for some students* This item could be 
made more difficult by cfianging the item to the 
following: 

A general in the Civil War wfto became 
President of the United States was: 

A. Washington 

B. Jackson 

C. Grant 

D. Garfieid 
E Eisenhower 

Students responding to this revised item would 
have to make finer discriminations to choose the 
correct answer* 

9* A test Item should stand alone unless deliberately 
related to other items. If a valuable item relates to 
other valuable items* then all the necessary related 
items should be tied together so that they will not be 
incorrectly used as isolated items, 

10* Each item should consist of clear* concise language and 
be definite and unambiguous in meaning* True-false 
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items should awid statements that aie partly true and 
panhr false or that contain qualifications or excep- 
tions. 

Ih Trick questions are to be avoided, and negative 
questions should be avoided as mudi as possible. 

12. Multiple^oice items ^ould be written in direct 
question or incomplete statement form, whichever 
form most effectively presents the individuat items. 

13. The distractors ^ould be independent and mutually 
exclusive. As far as possible, they should be arranged in 
numerical or logical order. 

14. Essay questions should be restricted to measurements 
of objectives not readily measured by other item types. 

15. Essay questions should be framed arouci specific 
problems and adequately delimited in scope. Each 
question should state clearly and accurately the desired 
extent and depth of the answer. It should state how 
many reasons, examples, arguments, and so forth are 
expected for the person to receive full credit for the 
item. The directions to ^explain, outline, state, and 
compare^' should indicare accurately the type of 
answer that wUl receive full credit. 

16. Computational problems should state the degree of 
precision expected in the answer. The question should 
state clearly the extent to which approximations or 
fractional answers are to be rounded. The question 
should state clearly whether units (such as square 
metre or metres per second) are to be included by the 
student in the answer. 

Reviewing the Mechanical 
Features of the Test 

In addition to judging the adequacy of test items, 
school districts must also examine several mechanical 
features of the tests that they intend to use. The following 
checklist should be helpful to them in making such an 
examination: 

• Item Format 

1 . Are the items in the text numt>ered? 

2. Is each item complete on a page? 

3. Does the reference material for an item appear on 
the saiTie page as the item or on a facing page? 

4. Are the item responses arranged to achieve both 
legibUity and economy of space? 

• Scoring Arongements 

L Has consideration been given to the practicability 
of a separate answer sheet? 

2. Are answers to be indicated by symbols rather 
than underlining or copying? 



3. Are answer spaces placed in a vertical column for 
easy scoring? 

4. If answer spaces are [^aced at the right of the page, 
is each answer space clearly associated with its 
corresponding item? 

5 . Are the answer symbols to be used by the students 
free from possible ambiguity due to careless 
penmanship or deliberate hedging? 

6. Are the answer symfbols to be used by the students 
free from confusion with the substance or content 
of the responses? 

• Dtstribution of Collect ReqKMtses 

K Are correct answers distributed so that the same 
answer does not appear for a long series of 
consecutive questions? 

2. Are correct artswers distributed to avoid an exces- 
sive proportion of items in the test with the same 
answer? 

3. Is patterning of answers in a fixed, repeating 
sequence avoided? 

• Gr'wpmg and Anan^ntent of Items 

1 . Are items of the same type requiring the same 
directions grouped together in the test? 

2. Where juxtaposition of items of markedly dissimi- 
lar content is likely to cause confusion, are items 
grouped by content within each item type 
grouping? 

3. Are items generally arranged from easy to more 
difficult within ihc iest as a whole and within each 
major subdivision of the test? 

• Directions for Answering Questions 

1 . Are simple^ clear, and specific directions given for 
each different item type in the test? 

2. Are directions clearly set off from the rest of the 
test by appropriate spacing or type style? 

3. Is effective use made of sample questions and 
answers to help clarify directions for unusual item 
types? 

• Con^ction for Chance 

1. If deductions are to be made for wrong answers, 
are students so infonr>ed? 

2. If no deductions are to be made for wrong 
answers, are students advised to answer every 
question according to their best judgment? 

• Pratting and DnpBcati^g 

1. Is the test free from annoying and confusing 
typographical errors? 

2. Is the legibility of the test satisfactory from the 
viewpoint of type size, adequacy of spacing, and 
darity of printing? 

3. Is the length of line neither too long nor too short 
for easy comprehension? 
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Considefations 
for ConduainQ en Assessment 



Students should be iafonned of the time^ date^ ind place of assessment in a manner that will increase 
their interest Special care should be taken not to arouse a student^s anxiety. Students may be told, for 
example, that no ^>ecial prepanttoo is necessary and that theii knowledge of the basic skills they normally 
use both at home and in school wiQ be assessed* They should be told that the purpose of the assessment is 
to identify not only those skills they have already mastered but also those skiUs they have not 
mastered. 

To give a pupil the best opportunity to demonstrate his oi her ability, the persons conducting the 
assessment should do the following: 

• To avoid fatiguing the students, conduct the assessment over several days, 

• Avoid assessing students^ dcills after the students have undergone periods of strenuous physical 
t iw r <i<». 



Avoid assessing students^ skills on a Monday or a Friday. 

If the assessment tasks must be perfontked within a set period of time, ensure that the time is 
available. 

If time limits are fixed, vst a stop watch to ensure that the time period is measured accurately* 

Isolate from ringing bells and other noises the area in which the assessment is to be made^ and make 
the area as quiet as possible* 

Avoid unnecessary interruptions. 

Have an materials prepared ahead of time and orgaruzed for quick distribution. 

Make certain that students know exactly what th^ must do before th^ begin each task in the 
assessment instrument* 

If the assessment requires a pupil to perform a mechanical operation, ensure that safety procedures 
are enforced* 

For a paper and pencil test, monitor all pupils to make certain that th^ are recording their responses 
correctly on their answer sheets. 

When assisting pupils or giving directions, guard against indicating the correct answer. 

Make certain that all personnel involved in administering the assessment instrument are familiar with 
all details of the assessment procedure^ hichiding the step-by-step administration, recording responses, 
and security precautiorts. 
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Sample Forms for Recording and Reporting 
Proficiency Assessment Data 
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Record of Student Proficiency Assessment-Reading 



Student's name. 



Identification number. 



^fkJencies 



Scene 



Na 1 



Date 



Ammed Conf eience 
Yes No Date 



Scote 



Date 



Aoessment Na 2 
Attained ICoiift 



Na3 



Yes 



No 



Soon 



Due 



AttMned Cotdwmx 



Yes 



No 



Diie 



L Given a leading sslection, the 
learner identified an example of 
illogical thinking, such as incon* 
sistendes in data, false assump- 
tioQS, and fallacies. 

2. Given a sentence containii^ a 
muitimeaiting word and given 
the complete dictionary defini* 
tion of the word, the learner 
indicates the meaning of the 
word appropriate to the context 
of the sentence. 

3. The learner followed written in* 
structions to fill out a given 
form Of application. 

4. Given a leading selection and a 
list of the main events in the 
selection, the learner ranked the 
events tn correct sequence. 
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student Progress Chart in Meeting Graduation Rertiirements 



Stodenrs nftme 


Record of pfogress in meetiiig objective, 
by number of objectiw 


Comments 


No. 1 No. 




Obseivitions HObsenoitkiiis 


Obseratnos 


1 


2 


3 H 1 


2 


3 


1 


2 


3 

















































































































































































































































































































































































































































Date. 



Teacher's naine- 
School 



Grade level. 
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Individual Student Mastery Report 



PROGRAM SPM106 FILE R78277I33 



NEWPOflT-HESA UNIFIED SCHOOL DISTRICT 



SCHOOL: ESTRAMCIA 
TEACHER: JOmSON 
GRADE: 09 

STUDENT NAME: 



NUMBER: 
SEQ. NO. 



78 TITLE: 
230 TEST DATE: 

PARAMETER FILE: 



GRAD REQ: COW- A 
06/10/77 

DISTRICT SERIES: 



ALL 



DATE 06/27/77 

TOTAL ITEM COUNT: 76 
TOTAL OBJECTIVE COUNT: 26 
TOTAL STUDENT COUNT: 



THE 


FOLLOWING 


OBJECTIVES HAVE BEEN MASTERED: 


§ ITEMS 


% ITEMS 


$ FOR LAST 


DATE 








CORRECT 


CORRECT 


MASTERY 


TESTED 


CMP 


2.3.3.2 


Given a mu It Ipl Tcatlon problefn with two proper fractional 


3/03 


100$ 


66$ 


6/10/77 






factors, the student wM t find the product and express it 
In Its simplest form. 






















CMP 


2,3,5.5 


Given any probleni Involving addition of decimal fractions, 
the student will find the sum. 


2/03 


67$ 


66$ 


6/10/77 


CMP 


2.3.8, 1 


Given a problem involving division of a decimal by a whole 


2/03 


67$ 


66$ 


6/10/77 






number, the student will find the quotient. 








6/10/77 


CMP 


2,3,8,2 


Given a problem Involving division of a decimal by a 
decimal, the student will find the quotient. 


2/03 


67$ 


66$ 


CKP 


2.4.1.2 


Given a numeral, the student will round It off to its 
nearest hundred. 


2/03 


67$ 


66$ 


6/10/77 


CMP 


2.4.1,3 


Given a large whole number of no more than six digits, the 


2/03 


67$ 


66$ 


6/10/77 



student will Identify the Indicated approximation for the 
given number. 



THE FOLLOWING OBJECTIVES HAVE NOT BEEN MASTERED 
CKP 2.1,4,5 
CMP 2.3.1,3 



CMP 2.3.6,5 

CNP 2.3.7,4 
CKP 2.3.8,3 
CMP 2.4,1, I 
CMP 2.4.1.5 




Given any division problem with whole numbers, the student 
wl 1 1 find the quotient. 

Given an addition problem of fractional numerals with un- 
like denominators wfth a sum of one or less, the student 
wl { \ find the sum. 

Given a subtraction problem Involving any type of decimal 
fractions, the student will find the difference. 



Given a multiplication problem with any type of decimal 

fractions, the student will find the product. 

Given a problem Involving division of a whole number by 

decimal, the student will find the quotient. 

Given a numeral* the student will round It off to Its 

nearest ten. 

Given an addition, subtraction, multiplication, or 
division problem of rational numbers, the student will 
name an Indicated approximation for the answer. 



n ITEMS 
CORRECT 
1/03 

1/03 



0/03 



% ITEMS 
CORRECT 
33$ 

33$ 



0$ 



$ FOR LAST DATE 
MASTERY TESTED 



66$ 
66$ 

66$ 



6/10/77 
6/10/77 





1/03 


33$ 


66$ 


6/10/77 


a 


0/03 


0% 


66$ 


6/10/77 




1/03 


33$ 


66$ 


6/10/77 




0/03 


0$ 


66$ 


6/10/77 
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Item Analysis Report 



NEWPORT-MESA UNIFIED SCHOOL DISTRICT 
PROGRAM P0E060 FILE IT0277 CMP DATE 06/17/77 

school/ ESTANCIA GRADE: 06/10/77 

EP AREA; COMPUTATION 

CATEGORY KO BASIC ARITHMETIC 
SUB-CATEGORY Kl COUNTING 

GOAL KKI The student will te atle to use arable numerals to count objects and words* 

OBJECTIVE Given the word fonn of a nwnber to billions, the student will read the word fonn 

and write its niOTieral name* 

ASSESSMENT ITEMS 



TOTAL RESPONSE ALTERNATIVES 



FORM 


ITEM 


ATTEMPTS 


SErjt 


jtWRG 


3tNR 


NR 


A 


B 


C 


D 


E 


A 


23 


109 


71 


28 


1 


1 


5 


5 


77* 


21 




A 


54 


109 


80 


12 


8 


9 


5 


87* 


4 


4 




A 




109 


55 


32 


13 


U 


3 


60* 


6 


23 


3 


TOTAL 


72 


327 


69 


24 


7 















subk:ategory 1*2 facts 

GOAL K2*l The student will be able to use The additiorVsubtractlon facts* 

OBJECTIVE 1*2*1.3 Given a series of open addition and subtraction equations of one-digit numbers, 
the student will complete them by finding the missing sum or difference* 



ASSESSMENT ITEMS 

TOTAL RESPONSE ALTERNATIVES 



FORM 


ITEM 


ATTEKFTS 


3tRHT 


jtWRG 


5tNR 


NR 


A 


B 


C 


D 


E 


A 


3 


109 


G9 


10 


1 


1 


7 


97* 


1 


2 


1 


A 


20 


109 


76 


24 






8 


9 


6 


3 


83* 


A 


76 


109 


74 


12 


14 


15 


5 


8r* 


3 


3 


2 


TOTAL 




327 


80 


15 


5 















GOAL 1 *2.2 The student wi 11 be able to use the multipl Icatlon/division facts. 

(BJECTIVE I .2.2.3 Given any srngle-digit multiplication or division combination with whole 
number quotient, the student will Identify the product or quotient* 

ASSESSMENT ITEMS RESPONSE ALTERNATIVES 



TOTAL 



FORM 


ITEM 


ATTEMPTS 


5ERHT 


3tWRG 


JNR 


NR 


A 


B 


C 


D 


E 


A 


49 


109 


86 


7 


6 


7 


1 


2 


94* 


2 


3 


A 


52 


109 


79 


15 


6 


7 


3 


3 


4 


86* 


6 


A 


77 


109 


75 


10 


15 


16 


3 


5 


82* 


1 


2 


TOTAL 




327 


80 


M 


9 















CATEGORY 2*0 COMPUTATION 

SUBK:ATEG0RY 2*1 whole number COMPUTATIOn 

GOAL: 2*1*1 The student will be atle to add whole numbers. 



Objective Matrix Report 

PROGRAM SPMI03 FILE R78277I33 NEWPORT-MeSA UNIFIED SCHOOL DISTRICT DATE 06/f5/77 



STUDENT PROGRESS MONITORING SYSTEM REPORfT #3 



SCHOOL: 


ESTRANCIA 


NUMBER: 


78 


TtTLE: 






GRAD REQ: 


COMP 


- A 












TOTAL 


ITEM COUNT 








78 


TEACHER: 


JONES 


SEQ. NO. 


: 235 


TEST DATE: 




06/10/77 
















TOTAL OBJECTIVE COUNT 






26 


GRADE: 


09 10 It 






PARAMETER FILE: 




DISTRICT 


SERiES 




ALL 










TOTAL 


STUDENT COUNT: 






ro 








SEP AREA: 


CMP 




OJP CMP 


CMP 


CMP 


CMP 


CMP 


CMP 


CMP 


CMP 


CMP 


CMP 




CMP 


CMP 


CMP 


CMP 




cvp 








CATEGORY: 


I 


I 


I 


2 


2 


2 


2 


2 


2 


2 


2 


2 


2 


2 


2 


2 


2 


2 


2 


2 








SUB CATEGORY: 


1 


2 


2 


I 


1 


1 


1 


I 


3 


3 


3 


3 


3 


3 


3 


3 


3 


3 


3 


3 
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Barry 


LISA 


ANN 
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X 
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X 


X 
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X 
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Clark 


COLLENE 
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X 
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X 












X 






X 






Gilbert 


MARY 


CATHERINE 
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X 
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X 


X 




X 






X 
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JEFFRIE 
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^*-X ■ 
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ELLEN 
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GEIA 
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X 
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SEQUENCE NUMBER TOTALS 



STUDENTS MASTERED: 


6 


8 


8 


7 


10 


9 


5 


7 


6 


6 


2 


3 


2 




5 


7 


4 


2 


5 


5 


STUDENTS MASTERED: 


60 


80 


80 


70 


100 


90 


50 


70 


60 


60 


20 


30 


20 




50 


70 


40 


20 


50 


50 


TOTAL # OF ITEMS: 


3 


3 


3 
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3 
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3 


3 
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3 
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2 
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2 


2 


2 


2 


2 
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PERCENT OF MASTERY: 


66 


66 


66 


66 


66 


66 


66 


66 


66 


66 


66 


66 


66 


66 


66 


66 


66 


66 


66 


66 



a>NTlNU£ ON FOLLOWING PAGE 



• 


Appendix 5Qf^p|e Form for Recording Information 
on Proficiency Assessment Conferences 




( as required by Education Code Section 51216) 


• 




• 
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Sample Form for Recording Information on Proficiency Assessment Conferences 





Assessment finduigs 


Conference notification 


Fmditigs 




Pareuttgoardtui) 
and student 
notificttion 


Rcsponable 
school official 


Written 


Phone 
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Assessment confcftenoe 


Instructional foIlow4ip 


school staff confen 
Fifticipaiits 


ident, 
met 


Action taken 


Ferson responsible 


begpn 


Conunents 










































































) 
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^T"*^ Background Information and Sample 
News Releases for the Media 

Sample ot backgrourHl information FROM: Name ot contact 

to be sent to the news media Address 

School district 
Telephone number 

Background Information on Assembly Bill 3408 

Certain provisions of Assembly Bill 3408^ enacted ki September of 1976* became efTective this year The 
student-oriented law is designed to: 

1* Ensure that every student graduating from high school in California has sufficient ability to 
understand what he or she reads, to communicate sufficiently in writings and to compute sufficiently 
in mathematics to survive as an adult in the world into which the student is graduating. 

2* Provide students with altemative means to complete courses mandated by law: American history and 
govenunent, science* physical education, matheniatics, and English. 

The First Proviston 

The first provision of the new law will be accomplished by a proficiency assessment and development 
program. Student proficiencies will be assessed at least once in grades seven through nir^e and at least twice 
in grades ten and eleven* After June, 1980, no student can be awarded a high school diploma who has not 
successfully completed the assessment procedures set by the district's governing board* 

The assessment procedures will show the student's ability to meet minimum graduation standards 
established by each school district governing board* These standards must be adopted by each local district 
by June, 1978. The standards must include, but need not be limited to» basic requirements in reading 
comprehension, writings and computation* 

Once a student demonstrates proficiency in the basic skills^ he or she need not be reassessed* 

A conference between educator, student, and parent must be held for each student who does not pass 
the assessment* Appropriate instruction must be provided in the ba^c skills for those students whc 4o not 
pass the assessment, thereby ensuring the student opportunity to develcp the proficiencies required for 
graduation* 

The Second Ptovision 

Tile second provision addresses an issue which did not exist in the prior law. Prior law required for 
graduation the completion of prescribed courses of study in English, American history and government^ 
mathematics^ science, and physical education* The new law still requires these courses, but it also requires 
districts to adopt ^alternative means" for students to complete them* Listed by the taw are such 
alternatives as "practical demonstration of skills and competencies, work experience or other outside school 
experience, interdisciplinary study, independent study, and credit earned at a postsecondary insdtution*" 

This law also requires that these altemative means be developed with the active involvement of parents, 
administratorSf teachers^ and students* 
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Sample News Release for Broadcast Media 

PROFtCtENCT ASSESSMENT FROM: Hame of contact 

Address/School district 
For imediate release Telephone number 



The high school graduating class of 1981 is entering ninth grade 
this year, and there*s special significance in that for them. The members 
of this class and those in every class that follows will have to pass a 
"proficiency assessment** sometime before their graduation to be eligible 
for a high school diploma. Students will be assessed at least once between 
the seventh and ninth grades and at least twice in the tenth through 
eleventh grades. Once a student demonstrates proficiency in the basic 
skills » he or she need not be reassessed. 

Although the class of 1981 has nearly four years to pass that 
assessment, local school districts have to act now. The standards on 
which the proficiency assessment will be based must be developed and 
adopted by each local school board by June of 1978. 

But believe it or not» students, some of the burden for passing 
this test also rests with the educators. This is true because the law 
also requires that special instructional programs be developed for each 
student who does not pass the test. So by the time students graduate, 
they will have acquired basic competencies in reading comprehension, 
writing, and mathematical computation. That*s what the program is all 
about. 
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Sample News Release for Newspapers 

ItEW PROGRAM WILL ENSURE ABILITY IN FROM: Name of contact 

BASIC SKILLS FOR GRADUATING SENIORS Address/School district 

Telephone ntnober 



For immediate release 



Today*s ninth graders and those who follow them will be required 
to pass a proficiency assessment sometime before they receive a high school 
diploma. This is the gist of a law which goes into effect this year and 
which gives school districts three years to prepare for it. 

Assembly Bill 3408, enacted in Septeinber, 1976, is designed to 
ensure that all high school graduates have sufficient ability in reading 
comprehension, writing, and math to survive as adults in the world into 
which they are graduating. 

Students will have at least three chances between seventh and 
twelfth grades to pass the assessment. The law requires that it be given 
at least once in the seventh through ninth grades and at least twice in the 
tenth through eleventh grades. 

Once a student passes the assessment, he or she need not take it 
again. But each time a student fails the assessment, the law requires that 
a conference be held between an educator, the parent, and the student; then 
appropriate instruction must be provided the student to strengthen those 
areas in which he or she is unable to meet the basic standards. 



—MORE— 
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ma PROGRAM VtlX ENSURE ABILITY IN 
BASIC SKILLS FOR GRAKIATING SENIORS 



erJc 



Assessment procedures will be based upon proficiency standards 
developed by each local board of education. Although the State Board of 
Education is providing each district with a sample assessment framework^ 
Including sample assessment items^ the districts are strongly discouraged 
from simply adopting these. 

"Each district is somewhat different in its needs and resources^" 
a State Department of Education spokesperson said. "So the State Board is 
emphasizing the desirability of each district in determining what the profi- 
ciency standards should be locally." 

These standards for graduation must be adopted by each local board 
of education by June^ 1978. The standards must include minimum requirements 
for reading comprehension^ writing^ and computation^ but they can also in- 
clude other requirements if the local board so desires. 

After June^ 1980^ students who have not passed the proficiency 
assessment test cannot receive a high school diploma. The class of l98l~ 
the first to be affected — entered the ninth grade this year. 

There is another provision in the law which is less noticeable 
but which is nonetheless important in that it opens new avenues of education 
for alX students. Present state law requires that students complete pre- 
scribed courses in English^ American history and government^ mathematics^ 
science^ and physical education before they can graduate. The new law still 
requires these ^ but it opens a new door by further requiring districts to 
"adopt alternative means for students to complete the prescribed course of 
study^ which may include practical demonstration of skills and competencies^ 
work experience or other outside school experience^ interdisciplinary study^ 
independent study^ and credit earned at postsecondary institutions." 

■ —MORE— 
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NEW PSOGRAM WILL ENSDSE ABILITT IN 
BASIC SKILLS FOR 6RADDATING SENIORS 



A further requirement Is that the alternative means be developed 
with the active involvement of parents, administrators, teachers, and stu- 
dents. 
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^■hT* Sample forms for Making 
Community Surveys 



Districts m/ty to use the bask format in ifte sampies in ^ appendix to depelop a commttnity 
sttrwey. 



Survey for Determining Minimum Requirements for High School Graduation 

DIRECTIONS: Plea^ respond to all of the following items. For each itein^ please place a dieck (-^) in 
etthei the YES ot NO column. If you think the item should be a minimum requiiement foT all students 
from high school^ check YES (-^). If you think the item should not be a minimum requirement for all 
students to graduate from high school^ check NO (-^)* 

Response 
YES NO 

In order to graduate from high school, all students should be able to do 
the following: 

READING COMPREHENSION 

L Find in the yellow pages of a telephone directory the telephone 

numbers of the stores that sell auto parts. 



2> From a job announcement posted in a public place^ list the 
qualifications needed to apply for a job. 

3* Read new spapers a nd magazines for enjoyment. 



MATHEMATICS 

4> Balance a checkbook. 

5. E)etermine which of two similar items on a grocery shelf is the best 
buy. 

WRITING 

6. Complete a job application without misspelling any words. 

7. Write simple directions that could be followed to fmd a street comer 
in the city. 
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Survey for Detennining Student Proficiency Levels for High School Graduation 



DIRECnONS: The puipose of this questionnaire is to obtam infonnation from students, parents* 
educators, and other a>nimunity members regarding the proflciency levek students should attain in reading 
a>mprehenston, computation (mathematics)* and writing. You axe asked to write your rating of whether 
the following skills are: essenrtah desimblCt or desirable for functioning effectively in contemporary 
society* These ratings will assist district personnel to know which skills must be assessed as a part of the 
high school graduation lequirements. Write a 1 to indicate you feel the skill is essential; 2, very desirable; or 
3* desirable* 

t-EssentuiL An individual must be able to perform this skill to function effectively in contemporary 



2~V€ty desirable. An individual could function effectivety in contemporary society without this skiU. 
However* performing this skill or subskill enables an individual to function more efficiently in 
contemporary society* 

3-Desirablei Performing this skill or subskill can be enriching but is not considered absolutely necessary 
for an individual to function effectively in contemporary society* 

READING COMPREHENSION 

A II students should be able to do the followmg: 

1 . Determine the correct meaning of a word by its use in a phrase or sentence (denotation)* 

2* Determine the correct feeling a word conveys by Its use in a phrase or sentence (connotation)* 

3. Identify words having nearly the same meaning (synonyms)* 

4* Identify words having a nearly opposite meaning (antonyms). 

S, From a group of words having identical sounds, identify the word that correctly completes 

the meaning of a phrase or sentence (homonyms)* 

All students will be able to comprehend literally the following (identifying or determining specific 
information which has been explicitly stated In a reading passage): 

6* Details (specific facts)* 

7* Sequence (specific order of incident or action)* 

S* Cause and effea (reasons for certain happenings and actions)* 

9* Main idea (central theme)* 

10* Cognitive outcomes ((x>nsequences of and predictions from)* 

n* Author^sdirection and purpose (author^s point of view)* 

All students will be able to comprehend interpretively or inferentiaily the following (using ideas 
and information explicitly stated to paraphrase* infer from, relate, or generalize from content 
contained in a reading passage): 

12* Details* 

13* Sequence* 

14* Cause and effect* 

15* Main idea* 

16* Cognitive outcomes* 

17* Author's direction and purpose* 

All students will be able to comprehend critically the following (making evaluative judgments by 
comparing ideas or information presented in a reading passage with some external criteria or 
by internal criteria provided by the student's experience, knowledge, or values, as well as 
judgments which focus on the qualities of accuracy, acceptability* desirability, or worth): 

18* Details* 

19* Sequence* 

20* Cause and effect* 



society* 
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2l, Main idea, 

22, Cognitive outcomes. 

23, Aiithor*sdiiectiDn and purpose. 

Ail smdents wUbedbleto demonstmremundentattdingof rheJoUowmg* at lea^t at a literal level 
of €ompfehmsk>n: 

^ - , ,._ 24. A story or article contained in a newspaper* magazinet report* monographs reference, or book* 
25. How to locate words, topics, persons* places, or things from an index or directory* 

-p 26. DocunKnts referencing events to times and places; for example, transportation schedules, 

movie listings, and class schedules. 
27* Bustoess forms referencing financial costs to descriptions and codes; for example, paycheck 

stubs, fines* taxes, billing invoices, and schedules of fees or rates. 

2S. Single product or brand advertisements* 

29. Multiple product and brands advertisements; for example, grocery ads*. 

30. Use of a matrix; for example, television and radio programming schedules, internal revenue 

service schedules, and insurance policy coverage. 

3 1 . Product hang*tags and product container labels; for example, directions for cleaning garments 

and ^up labels having directions for use, contents, and volume or quantity. 

32. Step-by*step directions for product assembly; for example, putting together a barbecue set, 

bicycle, and children's toys* 

33, Billboard and poster advertisements and announcements* 

34. Signs; for example, traffic signs* informational and directional signs, warning or cautionary 

signs, and bus names. 

35. Common legal agreement forms; for example* guarantees, warrantees, lease agreeir^nts, and 

insurance policies* 

36. Classified advertisements* 

37* Graphics; for example* figures, charts, graphs* and maps. 

38* Read*to-write forms; for example* empk>yment applications, credit applications* and common 

banking forms. 

NOTE: This questionnaire should be developed further to include the skill areas of writing and 
compuution, and these two sections should be written in the same basic format as the one used for reading 
comprehension. 
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Appendix 5gpr,p|e Management 
and Operations Ptens 



Two sample management plans and two sample operations plans are included in this appendix. 
Management Plan 1 was developed in greater detail than Management Plan 2. However^ both plans include 
essential activities to be completed in order to implement a student proficiency assessment system, as 
outlined in this guide. The two operations plans present the outlines for two selected management steps 
identified in Management Flan 2. 

Management Plan 

Major Msntgement Activities for the Dbtrict 

K Form task force to coordinate development and implementation of student proficiency assessment 
procedures. 

2. Conduct infonnational meetings >vith principals and teachers. 

3. Conduct informational meetings with parents. 

4. Conduct informational meetings with students. 

5. Ask school district governing board to invite key community representatives, principals, teachers, and 
students to serve on ad hoc committee. 

6. Provide orientation for ad hoc committee. 

7. Designate principals and teachers to prepare analysis of present graduation requirements^ including 
alternative means of instruction. 

8. Have ad hoc committee review present graduation requirements, including alternative means of 
instruction. 

9. Designate staff to prepare pilot version of parents students and staff questionnaire on graduation 
requirements (possibly including questions regarding alternative means of instruction). 

10. Have ad hoc committee complete pilot version of questionnaire on graduation requirements and 
instructional alternatives and recommend modifications. 

11. Designate staff to prepare final version of questionnaire on graduation requirements and instructional 
alternatives. 

12. Give questionnaire on graduation requirements to sample of students, parents^ and community 
members (stratified random sample would be preferred). 

13. Compile and analyze data. 

14. Designate staff to develop list of proficiencies based on questionnaire data. 

15. Have ad hoc committee review list of proficiencies and recommend modifications. 

16. Designate staff to prepare preliminary estimate of feasible methods for making an assessment of 
proposed student proficiencies. 

17. Send to superintendent and his or her designees for further review or modification a modified list of 
the proficiencies and proposed assessment instruments and procedures. 

18. Designate staff to develop assessment instruments and procedures for each identified proficiency. 

19. Have proficiency assessment instruments and procedures field tested. 

20. Based on field test data, refine and modify assessment instruments and procedures (and give second 
field test if necessary). 
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1-1 



2\, Have the supenntendent and his or her designees make fma] modiHcation ofpronciendes if warranted 
by Held test data. 

22. Send final list of proftciencies to board for public hearing, 

23. Have governing board adopt list of proftclencies. 

24. Designate staff to make recommendations on pupil proficiency perfonnance standards and differential 
standards to the superintendent. 

25. Have superintendent and his or her designee review recommended performance standards. 

26. Send recommended perfonnance standards to governing board for public hearing, 

27. Have governing board adopt prescribed proficiency standards* including differential standards. 

Major Management Activities for the School 

28. Compile and distribute student handbook on course of study and proficiency requirements. 

29. Conduct informational meeting for public hearing on adopted proficiencies and alternative means of 
instruction. 

30. Conduct departmental informational meeting3 for teachers anO counselors on adopted proficiencies 
and alternative means for students to achieve required levels of proi^ciency in basic skills. 

31. Conduct orientation of teachers and counselors on new requirements and programs. 

32. Have counselors or designated teachers conduct series of small group orientation sessions for students. 

33. Conduct individual conferences for students, as needed. 

34. Implement instructional program and assess student proficiencies at least once during the seventh 
through ninth grades and twice during the tenth through eleventh grades. 

35. Interpret and disseminate results of assessment. 

36. Arrange and conduct student performance conferences. 

37. Define, implement, monitor, and evaluate instructional program and individualized program of basic 
skills instruction, as necessary. 

38. Repeat cycles of assessment-conferencing-instruction until minimal proficiency in basic skills is 
established. 

39. Conduct an updated informational session for governing board and the public. 

40. Repeat appropriate portions of process. 

Management Plaa 2 

Major Management Steps for the District 

1. Identify minimal skills and knowledge required for adult life. 

2. Develop and Implement required courses of study and alternative programs. 

3. Develop proficiency assessment frameworks. 

. Establish standards of proficiency m basic skills as required for high school graduation. 

5. Have governing board adopt standards of proficiency. 

6. Disseminate information on standards of proficiency to interested publics (see Operations Plan 1 which 
follows). 

Major Management Steps for the School 

7. Assess student progress tow£^d proficiency at least once during the seventh through ninth grades and 
twice during the tenth throufjh eleventh grades. 

8. Interpret and disseminate results of assessment (see OperationsPlan 2which follows). 

9. Arrange and conduct student performance conferences. 

10. Define implement, monitor, and evaluate individualized programs of basic skills instruction. 
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IK Repeat cycles of assessfnent-conreTencing-instnicUon until mininol competency in basic skills is 
established. 

Each step in the managenient plan should have a conesponding operations plan. Operations plans for 
two selected managenient steps follow. 



Operations Plan 1 

The following describes an operations plan for management step number 6 in Management Plan 2. 



What 



1. Describe in writing the competencies required for 
graduation. 

2. List competencies and standardsof proficiency by 
basic skill area. 

3. Develop a statement of explanation as to compe- 
tencies or standards of proficiency: definition, 
purpose, context, development and selection, use, 
and implications. 

4. Develop statement of explanation as to existing or 
developing resources for helping students obtain 
minimal proficiencies: courses of study, skill labs, 
work experience, counseling, and tutoring (relate 
programs to competencies). 

5. Develop for parents, teachers, and students sepa- 
rate covering letters to go with the sUtements and 
lists. 

6. Send to parents of students entering the seventh 
and ninth grades (beginning with high school class 
of 1981) the covering letter, lists of competencies 
and the proficiency standards, and the statement 
of explanation. 

7. Ptovide inservice training for parents, teachers, and 
students if it is needed. 

8. Send to students entering grades seven and nine a 
letter describing the new requirements for gradua- 
tion. 

9. Publish lists of competencies , and . proficiency 
standards for high school graduation as a public 
record. 



Who 

{Districts des^nate 
named individuals ) 



When 



June, 1978 
June, 1978 
July-August, 1978 

July-August, 1978 
July- August, 1978 



Sept., academic years 
(beginning in 1978) 



Sept.-June, 1978-79 

Sept., academic years 
(beginning in 1978) 



Sept., 1978 
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operations Plan 2 

The following dcscnbes an operations plan for management step number 8 in Management Flan 2. 



What 



Who 

(Schools de^gnate 



When 



10, 



1] 



Describe fo/ each required skill the student's 
level of proficiency by calculating the percentage 
of performance indicators (test items) the stu- 
dent accomplished satisfactorily.^ 

Compare for each required skill the student^s 
actual level of proficiency with the minimal level 
of proficiency required. 

E)etermir^ as minimally competent the students 
whose percentage correct scores are equal to, or 
greater than, the mininial levd of profidency 
established for each required skill. 

E)eterrnine as deficier't in basic skills those 
students whose percuitage correct scores are 
lower than the minlntal levd of proficiency in 
one or more the skills considered necessary for 
graduation. 

Report each performance deficiency as the per* 
centage difference between the minimal level of 
proficiency and the actual level of proficiency; 
i^., a 20 percent performance deficiency in 
computational skills. 

List the skills and standards of profidency the 
student has and has not demonstrated. 

Develop a standard form or forms for reporting 
indivitj^ual competency^based test results in the 
basic skill areas of readings writing, and 
mathematics.' 

Develop a brief guide to the interpretation of 
competency^based test results. 

As soon as possible following each assessment of 
student progress, send the test results for individ* 
ual students to the student, the parents, and the 
school. 

Send test results for group data to the district 
and the school district Seeming board. 

As requested, provide training for all parties on 
the interpretation and implications of the test 
results. 



As soon as possible 
following each assess- 
ment of student 
progress 



May, 1980 



May, 1980 



June, 1980 

(latest surting date) 



July- Aug., 1980 
(latest starting date) 

Sept.-June, 1980-^81 



The formula \% strdghtforwaid: Level of proficiency 



Nuiiiber of correct indicators 



X 100 percent. When 



Total number of indicators 
performance indicators or test items ite weighted differently, the formub does not apply. 

'The reader should understand clearly that assessments of minimal competency in a or knowledge area cannot be 
interpreted or reported ierms of percentile ranic^ or a student's relative standing in any group. The mandates require that 
schools ensure their publics that students have achieved a certain level of proficiency, not juSt done as well as a certain 
percentage of other students. 
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^^^^^ Suggested Announcement on 
Proficiency Assessment to Be Given 
to Students 



Tfie foUowing note may be used by schools to explain the process of basic skills assessment their 
students. 



A Note to Students 

A new education law in California requites students to read, write, and do mathematics at required levels 
before being granted a high school diploma* The state Legislature passed the law because it believes some 
students graduate from high school without having learned important basic skills. 

An important part of this law is that the required levels of reading, writing, and mathematics skills are to 
be decided by each local school district* Therefore^ your school district may set standards which differ from 
the standards of neigfibonng districts* This is good, because each district can set standards based on the 
needs and goals of the students in that district* 

You can help make the new law effective* The implementation of the new law will probably create some 
changes in your school* In order to make those chants reasonable and acceptable^ your school district ^ 
need advice from you, your parents, and other people in the district* Watch for announcements in your 
local newspaper regarding your district's plans for setting proficiency standards and be ready to offer 
suggestions* 

M^t changes will take place? The law requires the following: 

1* Students will be tested at least once in grades seven through nine and twice in grades ten and eleven* 
If you pass the final test, which may be written but does not have to be, you do not have to take the 
test again* 

2* If you do not pass the test, your school is required to hold a conference with you and your parents or 

guardian to talk about where you have done well and where you may need some help* 
3* If you need help, your school is required to give you instruction to help you learn the basic skills* 

The important thing is to help students learn basic reading, writing, and mathematics skills* You cannot 
get a diploma just by passing the proficiency test in basic skills* Districts still have courses which you will be 
required to complete* Whe - you graduate, though, you will know that you are able to read, write, and do 
mathematics at a level that the community where you live decided was important* 
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Developing Proficiency Programs 
in California Public Schools: Some Legal 
Implications and a Suggested 
Implementation Procedure 



The governing boaid of each California school district 
maintaaning a junior or senior hi^ school is required by 
Assembly Bill 3408, as modtfkd by Assembly Bill 65,^ to 
adopt standards of proficiency in basic skills for pupils by 
June 1, 1978. Boards governing dtstiicts maintaining grades 
six or eight* or the equivalent, must do the same by June 1, 
1979.^ The new law further provides that "subsequent to 
June, 1980, no pupil shall receive a diploma of graduation 
from high school if he or she has not met the standards of 
proficiency in basic skills prescribed by the secondary 
school district sovecning board."^ The stated intent of the 
Legislature in passing the new law was that **pupils 
attending public schools in California acquire the knoud- 
edge, skiUs» and confidence required to function effectively 
in contemporary society.*** 

The deadlines imposed by the new law raise serious 
questions about whether school districts will be able to 
(tevelop and implement new proficiency standards in a 
sound and careful way. The deadlines also raise serious 
questions about whether school districts will be able to 
comply with the new law without being unfair to students, 
ihus making districis vulnerable , to legal challenge by 
students and parents. Although districts obviously cannot 
be guaranteed immunity from legal problems, the purpose 
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of this article is to suggest a two-phase implementaiion 
procedure tlut is designed to meet the requirements of ihe 
rtew andf at the same time, to reduce ihe risk of legal 
attack by parents and students. 

Since it is important to understand the legal and policy 
analysis that forms the basis for this two-phase implementa- 
tion procedure, this article is divided into the following 
parts: 

• Model Approach toSettingNewGraduationStandards 

• Racial and Linguistic Discrimination 

• Inadequate Notice and Phase*In periods 

• Inadequate Matching of Test and Instruction 

• Implementation Procedure: Phase 1 

• Implementation Procedure: Phase II 

• Community Involvement 

• Approaches to Instructional Validity and Assessment 

• Some Concluding Cautionary Notes 

Modd Approach to S^ing ^4ew Giaduation Stan<hrds 

Before new graduation standards u^d as a basts for 
denying any student a diploma* a sound and careful 
approach to setting the new standards should: 

1 . Provide for substantial parental and other community 
involvement in developing and adopting educational 
goals, performance objectives* and assessment proce- 
dures. 

2. Provide suflficiently detailed advance notice of the 
p^w educational g&als, performance objectives, and 
assessment procedures to students* parents, and 
teachers. 

3. Make necessary changes In curriculum to reflect new 
educational ^ais and performance objectives. 

4. Take steps to ensure that classroom instruction 
reflects the new curriculum. 

5. Provide for a suflficient phase^n period of the new 
curriculum and instruction. Sufficient phase^n may 
take years, depending upon the degree of curricular/ 
instructional change. 

6. Take steps to ensure that the assessment procedure 
meets professional psychometric standards and has 
instructional validity (as defined below). 

While obviously difficult to implement prior to the law^s 
June, 1980* deadline, this kind of approach could be 
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implomented by liistricts v^ithout grc;it difficulty as part of 
the twophaiie implctncntation procedure described below^ 
The [cquirement that no student can be given a diploma 
of graduation after June* 1980. unless he or she has met the 
newly adopted proficiency standards means that school 
districts fna>^ run a high risk of confronting the kind of legal 
problems set forth in *Tompeienc>' Testing: Potential for 
Discrimination'' (Merle McClung. Qeann^ouse RePtcw, 
September. 1977* pages 4^9-47)^ and in ''Are Compe- 
tency Testing Programs Fair? Le^l?*" (Merle McClung, 
Delta Kaftan, Fcbruai>. 1978. pages 397-400). These 
legal problems might be raised by^ students and their parents 
if competency testing programs are characterized by the 
following: 

1. The potential lor racial and linguistic discrimination 

2. Imdequate advance notice and phase-in periods prior 
to the initial use of the test as a graduation require- 
ment 

Po!;sible lack of psychometric validity or reliability of 
the tests 

4. Inadequate nmch bem'cett the instmctiottai program 
and the test 

5. Inadequate remedial instruction thai creaies or re- 
intorces tracking 

6. Unfair apportionitient of responsibility between stu* 
dents and educators for test failures 

Readers interested in a more detailed legal and educa- 
tional analysis of these six ptoblem areas m^y want to read 
the "Competency Testing" article mentioned earlier* This 
article will focus on the second and fourth problems, which 
are italicized above and summarised below. First of all. 
however, the problem of discrimination against racial and 
linguistic minorities will be briefly discussed. 

Racial and Lin^istk Dtscnminatton 

While substantial numbers of white iniddle<lass students 
cannot meet minimal competency standards, some evidence 
indicates that a disproportionate number of black and 
Hispanic students will not be able to meet the proficiency 
test lequirements* This pattern has in fact occurred where 
competency^ testing programs have been implemented. For 
example, when the E^lm Beach County. Florida, schools 
6r£t used the Adult Performance Level Test published by 
American College Testing. 42 percent of the district's 
minority students failed in from one to five content areas, 
whereas only S percent of nonminority students didso*^ 

Recent U^* Supreme Court decisions indicate that 
federal law requires proof of discriminatory purpose in 
order to invalidate a public school testing program that has 
a racially disproportionate effect. As a fedc^ral consti* 
tutional matter, the Supreme Court in Washmgton v, Da)^is^ 

^Copifti of this arlidc (hereaner inferred to 3» "Competency 
Tefttng^> aie ^fiiahlg from the Onicr for Law and Education* 6 
Appian Way, Cambridee^ MA 021 38. 

^Palin Beach Fost-Times, MaV la 1971 

^96 S. Cl 2040(1976). 



held that the disproportionate racial impact of a test (in 
this case, a police department's personnel test) was not 
sufHcient to esublish the unconstitutionality of the test 
without proof that it reflected a racially discriminatory 
purpose* The Coun, however, stated that such dispropor* 
tionate racial impact could be etidenee of a discriminatory 
purpose* In Regerjts of the University of Cdifomta v. 
BaStkefi the Supreme Court extended this discriminatory 
purpose standard of Title VI of the Civil Rights Act of 
1964, 

More important to California school districts is the fact 
that some of the lelevant state constitutional standards are 
stronger than the federal constitutional standards* For 
example, the California Supreme Coiut in Crawford v. 
Board of Edtication of the Oty of Los Angeles^ empha- 
sized that since the 1963 decision in Jaekson v. Pasadena 
School Distriet. it has been the law ^'that in this state 
school boards do beat a constitutional obligation [under 
the state constitution) to take reasonable steps to alleviate 
segregation in the public schools, whether the segregation 
bede faeto or de jure in origin/^'** 

The basic problem is that denying black and Hispanic 
students diplomas for failure to pass a proficiency examina* 
tion threatens to expose past discrimination and lUegalities 
in tnany California school districts. This is not mere 
speculation* State and federal courts have found unconsti* 
tutional discrimination a^inst tacial and linguistic minor* 
ities in many California school systems/' and the adjudi* 
cated cases certainly do not encompass all the racial and 
linguistic minorities ^o have been subject to discrimi* 
tuition in California schools* 

Consider, for example, a school district that— pursuant 
to Imu V* Niehois,^^ related HEW memorandums,'^ and 
state taw—has implemented irteaningTul bilingual programs 
for limited* and non*£ng)ish*speaking students at the 
elementary grades but has not provided adequate bilingual 
programs for the first group of limited* and non*Engtislt* 
speaking students scheduled to graduate after June. 1980 
(this yearns tenth graders)* Hispanic students who cannot 
pass tlie test (required to be given in English) by June of 
1981 might argue that denial of the diploma is illegal 
because it simply reflects unequal educational opportunities 



^46 Law Week 4896 (6/27/78). 
^PaeifleRepori^ (Second series). Vol 55 (1976), 28. 
'**lbid.,p^34, 

' 'Sec. for example. NAACF v. $4in Bernardino Unified Sehooi 
Distriet, $$\ P. 2d 48 <1976);S/wnjter "t. Pasodtnn City Board of 
Education. 311 RSupp. 50t (CD.Cal. 1970); S<mc v. Qxn^d 
Schooi Dimiet Board of Thtsteest 386 F.SuPp. 539 (CD.Cal 
1974); Hernandez v. Stoekton Unified Schooi District, No. 1Q1Q16 
(Superior Court of San Joaquin Couniy. October 1. 197 4)1 Ftores v. 
El Centro Sehooi Distriet (Superior Court of Los Angles. Com- 
plaint, October 9, 1975) (case pendiini:). 

* ^Suprtmt Court Repornr, Vol 94 ( 1974). 786. 

'^See HEW memorandum "IdentillcaUon of Discrimination and 
Denial of Services on the Basis of National Origin" (May 25, 1970) 
by Orrioe for Civil RiS^U Director J* Stanley Potting^r* Also see 
subsequent memorandums: "Evaluation ^f Voluntary Compliance 

nans " (Summer. 1975) and ^Application of Lau Remedies** 

{April 8^1976)* 
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provided by the district. Similarly, a school district under 
federal or stale couri order to desegregate its schools might 
carry forward the effecis of prior discrimination if it denies 
a diploma to minority students subjecred to unequal 
educational opportunities. Black and other minority stu- 
dents tn such a situation might argue that denying them a 
diploma is in effect "blaming the victims," In analogous 
situations (for example* cases involving ability grouping and 
voting rights), the federal couns have held that practices 
that cany forward the effects of prior racial discrimination 
ate prohibited 

Apart from these gwral statements, space will not 
allow a more detailed discussion of racial and linguistic 
discrimination because analysis must be geared to the 
specific situation in each district. Basically^ any school dis- 
trict will fall into one of the fdlowing three categories: (1) 
with a court finding of prior discrimination; (2) with no 
such finding but vulnerable to such a finding if the issue 
were to be litigated; and (3) with no such finding since the 
district has provided equal educational opportunities to all 
of its students* There are many variations on these three 
situations, and each district should seek legal consultation 
to determine whether past practices in the district com- 
bined with its version of proficiency testing constitute 
racial or Linguisiic discrimination* Districts that have 
already been found to have discriminated, or that are 
vulnerable to such a finding* must be especially sensitive to 
the discriminatory poteniial of proficiency testing and 
should design their programs lo account for possible 
problems. 

These concerns about racial and linguistic discrimi- 
nation* aggravated by other considerations about the 
fairness of proficiency testing for all students regardless of 
racial or hnguistic background (discussed below), raise 
serious questions about the need to amend the law to 
account for these problems ani possibly to postpone its 
effective dale for some years* For example, the law could 
be amended lo exempt school disiricts found lo be subject 
to prior discrimination until such time as the effects of the 
discriminatory practices have been eliminated* With or 
without this kind of amendment, such districts should take 
steps to eliminaie the effects of prior discrimination* 
The purpose of this ariicle, however, is to offer school 
districts some guidance with respect to some of the 
problems they will face in trying to develop equitable 
programs that are consistent with the new law* 

Except for son^ general 'comments about the field- 
testing of assessment proceduies, this article will not 
specifically address the serious problems of racial and 
linguistic discrimination in any further detail due to the 
complexity and scope of these problems and the need for 
dislrict-by-district determinations* It must be emphasized, 
however* that while the two-phase implementation proce- 
dure suggested below can help to make the proficiency 
testing program fairer for all students, it will not provide a 



For cases and discussion sec footnotes 34-36 and the related 
text in •'Competency Testing" (see fooinote S on page K-2X 



remedy for the underlying problem of prior discrimination 
against racial and linguistic minorities in many school 
<Sstricts; therefore* other steps will be necessary in those 
districts. The E>epann^nt of Education plans to issue an 
advisory to assist school districts in this area. 

Adequacy of Notice and Phase-in Periods 

The 1981 deadline in the California law means that the 
requirement will be first imposed upon students late in 
their secondary education with hmited prior notice. The 
first class of students subject to the new law will have spent 
most of their years in the school ^stem without notice or 
knowledge that passing a proficiency test would be a 
condition to acquiring a diploma. The school district in fact 
would have explicitly approved their progress by promoting 
them each year even thougjh many of them did not have 
basic skill proficiencies* It is likely that many, if not most, 
of those students failing the test would have studied 
differently (and teachers taught differently) in earlier years 
had they been given such notice* The proficiency test Is 
designed to ensure that minimal proficiency is acquired 
after twelve years of schooling, but the first group of 
students would not have received notice until their ninth 
year of school 

The exact daie of notice will vary from school to school* 
In most districts there will be one date when students are 
given general notice of the proficiency requirement for a 
diploma and a later date when students are g^ven notice of 
the specific performance objectives to be measuied by ttie 
proficiency test* Students, parents, and teachers should be 
given notice of these performance objectives and the 
assessment procedures as soon as possible after they have 
been established* 

Traditional notions of due process may require adequate 
prior notice of any rule that could cause irreparable harm, 
to a person^s educational or occupational prospects. 
Whatever notice is considered fair in this situation, notice, 
after most of one*s educational program is completed may 
be inadequate, especially if the proficiency test is designed 
to measure knowledge and skills not previously taugjht in 
the district's classrooms* The importance of matching ttie 
assessment procedure with what has been taught in school 
is discussed in more detail in the next section* 

Inadequate Matching of Test and Instruction 

Most persons would agree that fairness requires that a 
schooPs curriculum and instruction be matched in some 
way with whatever is later measured by the test* In other 
words, tlie test would be unfair if it measured what the 
school never laugjht* This concept should be considered in 
teims of both curricular validity and instructional validity* 

QifTicular validity is a measure of how well test items 
represent the objectives of the curriculum* An analysis of 



^^For cases and discussion see footnotes 56 and 57 and the 
fciated text in "Competency Testing" (sec fooinote 5 on page K*2)* 
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cuiricular validity would require compiriscn of the test 
otqecttves with the school's course objectives. For example, 
if the curnculum was not designed to leadi functional 
competency, it would be unfair lo deny students their 
diplomas because they did not leam to be functionally 
competent* In such a situation failure on the proilciency 
test should reflect badly oa the school for not offering an 
appropriate curriculum, 

A competency test should also have what may be called 
instmcTioml vaMity, Even if the curricular objectives of 
the school correspond to those of the proficiency test, some 
nieasure must be found to determine whether the school 
district's objectivses were uanslated into topics actually 
taugfit in the dassrooir^. While a measure of curricular 
validity is a measure of the theoretical vahdity of the 
proficiency test as an instrument to assess the success of 
students, insuuctional validity ts an actual measure of 
whether the schools providingstudents with instruction 
in the knowledge and skills measured the test. Insuuc- 
tional vaUdity obviously does not require prior exposure of 
the student to the exact questions a^d on the test, but it 
does lequlre aau^al exposure to the kind of knowledge and 
skills that would enable a student to answer the test 
questions. Establishing instructional vaUdity in some cases 
will be difficult; in others, it will be relatively easy. Some 
suggestions about how schools might do an initial check for 
the instructional validity of their assessment procedures are 
set forth belowJ^ 

It is important to note that content validity* as defined 
by the American Fsychological Association,^^ does not 
ensure either curricular or instructional validity. They are 
related, but distinguishable^ concepts. Content validity is a 
measure of how well test items represent the performance 
domain that the test purports to measure (for example, 
adult performance skills) but not necessarily a measure of 
how well the test items and performance domain represent 
either a particular school's curricular objectives or instruc- 
tion. Instructional validity should be the central concern 
because content and curricular validity mean very little in 
this context if the test items are not representative of 
instruction actually received by the student. 

The instruction and the test can be matched in one of 
these two basic ways: (1) design instruction to reflect the 
test; or (2) design the test to reflect instruction. Given the 
timetable requiitd by the new law, most school districts 
may not have sufficient tirrie to design and implement new 
curricula and insUucuon to match new test objectives. 
Since it is difficult in the short term to change instruction 
to fit the test, the first phase of the implementation 
procedure described below suggests designing the test to fit 
instruction. 



^See notes 25-28 and lehled text on pagp* K-6 and 
Stmdar^ fot Educatkmd and Psychologk/tl 7>iii. Prepared 
by the American HytAioiopc^ Associition* Washington. D,C.: 
American Piydiologrcai Association, 1974, p.28. 



ImplementatioQ Pkocedtue: Phase 1 

In attempting to resolve the questions of legality and 
fairness raised by this artide, the persons responsible for 
developing a proficiency program in any California school 
district may want to recommend to the members of the 
governing board that they adopt a two-phase implementa- 
tion procedure* The first phase would emphasize that the 
proficiency standards to be met by the first ciass of 
students to graduate after 1980 be formulated on the basis 
of the curriculum and instruction to which tiiese students 
have already been exposed for most of their educational 
careers in the district's dassrootns. In other words, during 
the first phase the focus would not be on which proficiency 
skills the goveining board ^d community think should be 
taught and emphasized in the district's schools but rather 
on those proficiency skilts that have been taught and 
emphasized previously by the district* In some schools 
there will be no actual distinction between what should be 
emphasized and what has been emphasized, but in other 
schools the distinction will be substantial* The distinction 
wiU probably be reflected in the difference between basic 
literacy and numeracy skills emphasized by most schools 
and the adult-life skills emphasized by most competency 
tests. 

This distinction between basic literacy/numeracy skills 
and aduh-life skills is crucial* Adult competency tests 
usually go beyond basic literacy and numeracy skills 
because the tests are designed to measure an individual's 
ability to apply basic literacy/numeracy skills to necessary 
adult-life role activities, such as those of consumer^ pro- 
ducer, and citizen*^^ The comparable terms used in this 
guide— ^^school context*' skills and ^afunctional uansfer" 
skills— also reflect this important distinction.'^ 

Examples of adult-Ufe (functional uansfer) skills include 
the ability to understand common indexes for comparison 
shopping; to understand Ihe nutritional ingredients neces- 
sary for a balanced diet; to understand a contract for a car 
loan or home mortgage; to read a newspaper with compre- 
hension; to fiU oul a job or loan application ; to complete a 
tax form; to balance a checkbook; to follow a recipe in 
preparing a meal; to understand proper behavior and 
attitudes for getting and keeping a job; to use leisure time 
productively; and to participate as a citizen in the com- 
munity, state, and nation,*** 

1 A 

If the purpose of the proficiency test h to measure the 
minimal competence required in the adult world, the test should 
also have predictive wiUdiiy or an acceptable substitute* Predictive 
validity requires a comparison of the predictions about each 
test-taker based on the test results ^>Ai\^ the actual functioning of the 
test-taker at a later time. 
''Pags 111-9. 

*^As noted on 398 of the Fhi Mis Happen artjCte 
page IC-2), the actual test questions should be sut^a to close 
scrutiny to avoid questions that <L) measure knowledge and skills 
not necessary in the adult world; (2) discriminate on the basis of 
race or culture; (3) invotve mandatory personal or social behaviors 
that inftlnge upon an individual^ freedom of choice; or (4) attempt 
10 measure affective aspects of social responsibility, good dtizen^ 
shipf self-concept^ and job preparedness that may not be measurat>le 
or teachab^ 
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• _ Some people do not think that the distinction between 
basic Uteiacy/numeracy skills and adult-life skills is an 
iinpoitant one since they believe that a student with basic 
literacy skills will have no difficulty passing an adult-life 
^lls test even if he or she has not been exposed to 
adult-life dcills in the classroom. They aigye that students 
who can add and subtract a series of four-digit numbers on 
a basic numeracy skilh test item, for example, will be able 
to do the same in the context of a tax form item from an 
adult-life skills test* However^ many students^ especially 
•^bordeiline" students, will have difficulty with the kind of 
transference skills called for in an adult-life skills item. In 
fact, many of these students are probably borderline 
students because they have difficulty with transference. 
Therefore, school districts that plan to test for adult-life 
skills should have curricula and instruction that emphasize 
transference as well as the other knowledge and skills 
necessary to answer the adult-Ufe skills items* 

An adult-life skills item, sach as adding and subtracting 
four-digit numbers on a tax form, is also more diflficult than 
its baste numeracy components for other reasons, including 
the fact that (1) the forms usually require literacy as well as 
numeracy skills; and (2) an official form can be distracting 
and intimidating, especially if the students are not familiar 
with the form. Of course^ it is possible to write a basic 
4 literacy or numeracy skill item which is more difficult than 
its adult-life skills counterpart or to make an addt-life skills 
test easier by allowing a lower cutoff score than for the 

• literacy/numeracy skills test* But in general an adult-life 
skills test, designed to measure the sarr^ literacy and 
numeracy skills as a basic literacy/nunuracy skills test, will 
probably be a more difficult test for most students; and a 
school's curriculum and instruction should account for 
this difference. Mftiatever the content or nature of the 
proposed test, school districts should provide for field- 
testing to refine the test and to determine its likely effects. 

Greater curriculum revision and longer phase-in periods 
will be necessary where adult4ife skills are being empha- 
sized for the first time* Using a proficiency test that 
measures adult-life skills that were never taught in school as 
a basis for denying a diploma may violate due process of 
law. A proficiency test lacking curiicular or instructional 
validity might violate substantive due process because when 
given such a test, the students are being penalized even 
tliough their poor performances on the test are not their 
fault-^' 

Proficiency standards based on what has already been 
emphasized in the classroom will obviously minimize the 
phase-in and instruction/tes£ match problems mentioned 
above. The next {question is whether proficiency standards 
based on what has already been tai^bt meet the rec^utre- 
ments of the new California law* Many persons in California 
have been assuming that the new law requires the kind of 
adult-life skills approach reflected by most competency 
tests* Such tests would certainly be consistent with the new 
laWf but baste literacy/numeracy skills by themselves could 
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be consistent with the requirements of the new law if 
district's governing board decides that such proficiency 
skills provide students with ^the knowledge, skills, and 
confidence required to function effectively in contem* 
porary society" (see footnote 4). The specific statutory 
requirement is that the proficiency standards ^shall include, 
but need not be limited to, reading comprehension, writing, 
and computation skills, in the English language, necessary 
to success in school and life experiences, and shall be such 
as will enable individual achievement to be ascertained and 
evaluated** (Education Code Section 51215). 

This statutory provision sets the framework within 
which proficiency standards must be developed, but the 
framework is designed to provide each district with great 
discretion in determining its own educational goals, perfor- 
mance objectives, assessment procedures, cutoff scores, and 
so forth. This broad discretion on the part of individual 
districts is the central distinguishing feature of the new 
California law when compared to competency testing laws 
in other states^ such as Florida* 

In the author^s opinion a governing board would meet 
the basic requirements of the new law as summarized in the 
first paragraph of this article if it does the following: (1) 
concludes (after active involvement of parents, educators, 
and students^^) that the reading comprehension, writing 
and computation skills that have been previously taugfit in 
the district are "necessary to success in school and life 
experiences**; (2) adopts by June 1, 1978, the basic 
literacy /numeracy skills already emphasized in the district 
classrooms as its proficiency standards; and (3) applies 
these standards as a diploma requirement for students who 
will graduate after June, 1980* 

Thus, Phase 1 standards are essentially past standards- 
those that have already been emphasized in district class- 
rooms. Students, parerus, and teachers should still be 
notified of Phase 1 starioards aS ^Oii ^ the siafldatds are 
adopted. Even thou^ the standards will not have changed, 
both the assessment procedures and the penalty for failure 
to meet the standards (denial of a diploma) are new; 
therefore, advance notice is essential. Phase I standards 
should be retained until the new curriculum and instruc* 
tion, if any, have been phased in and adequate notice is 
given to students^ parents, and teachers* A new curriculum 
and new standards, if any, are the focus of Phase II. The 
planning for Phase 11 should begin simultaneously with the 
implementation of Phase K 

Implementation Pkoceduie: Phase n 

Given the severe nature of the penalty to be imposed on 
students who cannot meet the district's Phase 1 standards 



^^See the Educational Accsou nubility aci of Ftcfida 
School Laws (1976 Chapter 229.55 ^nd those tuUowing, 
espedaUy diapters 229*8t4, 2301231 1, and 232*24* 

^^ommunity involvement in setting standards ofproHciency is 
lequiied by the newlaw. See Education Code Se<:tk>n 51215* 

^^Fot cases and discussion see footnotes 56 and 57 and the 
related text in ^'Competency Testing.** Also see the related 
discussion in tliis artide on i»age K*X 
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(denial of a diploma), a school district migfit, as a policy 
matter* want to reevaluate its traditional standards and 
develop new» more appropriate standards. If the school 
district decides to develop a second phase, it might want to 
consider following the ax basic steps suggested (on page 
K*2) as the basis for a model procedure-starting with 
substantial community involvement and concluding with a 
careful analysis of the psychometric and instructional 
validity of the assessment procedures. Some suggestions 
concerning community involvement and instructional valid* 
ity follow. 

Community Involvemoit 

Since various groups within the community will have 
different expectations about \Wiat proficiency standards are 
necessary to function effectively in contemporary society, 
steps should be taken to ensure that community involve* 
ment is representative and substantial The statutory 
requirement for community involvement prior to adoption 
of Phase 1 standards should also be met in developing Phase 
tl standards: ''Standards of ptoficiency shall be adopted by 
the pjveming board with the active involvement of parents 
broadly reflective o( the socioeconomic composition of the 
district, administrators, teachers, counselors, and^ with 
respect to standards in secondary schools, pupils^ (Educa* 
tionCode Section 5I2I5). 

Written questionnaires and community survey forms can 
be helpful tools if they are written in simple language 
understandable by persons with varying levels of profi* 
ciency themselves. Such questionnaires and survey forms, 
however^ almost by definition, self-select and narrow 
community involvement and are, therefore, likely to 
exclude large numbers of persons in lower socioeconomic 
groups. Thus, such forms should be supplemented or 
replaced by a series of community meetings at which the 
opportunity is presented to react to proposals and to 
suggest alternatives. 

Whatever the approach— surveys, community meetings, 
or some other-the members of the community should be 
provided with enough information about this ]m|>ortant 
and complex subject so that they can make intelligent 
choices. For example, the questions put to the community 
should not be written assuming adult*life standards and 
fHY>cedures since this is one of the crucial choices that has 
to be made. As mentioned previously, many persons in 
Califomia have made the questionatde assumption that the 
new law gives district goveming boards no choice but to go 
beyond basic literacy/numeracy skills and emphasize adult* 
l]fe*skills in curriculum and assessment If the reasons are 
properly explained, the community should understand and 
support the rationale for limiting the first phase of 
proficiency testing to knowledge and skills previously 
emphasized in the dic^trict^s classrooms and delaying the 
second phase (if there is to be one) until the new 
educatKMial goals and performance objectives can be suffi* 
dently integrated into the curriculum and instruction. If so^ 
the community and school personnel in the first phase can 
focus on which parts of the existing curriculum and 
instruction are "necessary to success in school and life 



experiences" (Education Code Section 51215) and would 
be fair to include on a proHciency test. 

Approaches to Instnictioaal Validity and Assessment 

The assessment procedures, whether developed as part of 
Phase 1 or Phase II , should meet professional psychometric 
standards and have instructional validity as defined pre* 
viously. This section will contain a description of some 
approadies to instructional validity and a consideration of 
direct performance measures as an alternative or supple* 
ment to the tnditional paper *and*pencU test. 

In developing or selecting an assessment instrument* 
school districts should take steps to ensure the instructional 
validity of the instrument. Although content validity is a 
distinguishable concept for reasons set forth earlier* it is 
sufficiently related to offer guidance in determining the 
instructional validity of a proposed instrument. One 
approach is suggested by the Educational Testing Servicers 
study of the National Teacher Examination^ which is given 
for certiftcation purposes in North Carolina. The method 
used by the testing service involved an examination of the 
content domain of the National Teacher Examimtion in 
relation to the content domain that should be measured if 
scores are used for initial certification of teachers. The 
researchers determined that the content domain that the 
test should measure was the content of teacher education 
programs offered by North Carolina colleges: 

There are four sets of data that are measures of the 
correspondence between the content of the test and content 
of the teacher training program: (1) Uie percentage of questions 
classified as content appropriate; (2) the number of content 
areas identified as omitted ftom the test; (3) the judgments 
about lelaUve em[^asis on specified subject matter in the test 
and m the teacdier training program; and (4) the overall 
judgments with respect to wheUier the test parallels the 
curriculum. Crileiia were established with respect to each of 
these sets of data to identify the degree of relationship between 
the test content and the program content. These criteria were 
applied individually to each test in the Common Examinations 
and each of the Area ExamicyLjions^ ami the interrelationships of 
criteria were also considered. 

Readers interested in this approach will want to refer to the 
(XHnj^ete report for details on how these determinations 
were made ^d what degree of match between test and 
program was considered sufBcient.^^ This approach could 
be adapted to measure instructional validity by relating test 
content to instruction in specific schools (rather than to 
curriculum on a statewide basis). Furthermore^ a sound 
approach would be to support judgments about instruc* 
tional validity with evidence of actual instruction. 

Schools will have to play a key role in the development 
of the assessment instrument even if» and perhaps espectatly 



^eporr on a Stucly of tht Use of the piFationai Teacher 
Examiruitioft by the State of North CaroUnc. Prepared by the 
Educattonai Testing Service. Princeton, N.J.: Educational Testing 
Service, 1976, p. 159. 

^^See especially the chart and related explanation at page 5 of 
the Educational Testing Servicers report The reference to the report 
here and in the text js ftor illustration purposes only and is not 
intended a« an endorsement <>f the approach described in the report. 
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if, they contract with ;in independent test publisher* 
Pophani h;is noted the dilemma lest publishers face with 
proficiency /competency testing bec^iuse their te^ts will have 
to be based upon curriculum much more so than their 
traditional standardized tests, thereby making their instni- 
fronts usable only to distncts with very similar curricula,^' 
This problem will be especially acute in Cafifomia. The new 
bw specifically precludes the State E>epartment of Educa- 
tion from developing a statewide standard^ making each 
distnct responsible for developing its own standards (Edu- 
cation Code Section 51217). 

One way in ^ich test publishers are attempting to solve 
this problem is to create "item pools, Distncts that have 
specitlcations based on their leamer objectives can match 
their specifications with those for which items and exercises 
have already been prepared by the test publisher. Whatever 
approach is used in test development or test selection, the 
district will need to make important determinations about 
whether the proposed instrument is sufficiently related to 
curriculum and instruction* The following advice that 
Melville offers school districts in selecting an achievement 
lest is g&nerally applic^ible to proficiency /compe I ency tests: 

jTlhc mosiimporuni elements m pood tesi selection \m\ : 

How well does J test measure wh^t it was selected lo 
measure? Aie the things being measured important? Is there a 
proper balance ot atea^ covered? Are all the important areas to 
be Uiught included? Xc on^- salesmen, neighborine school 
oollca^e. kamcd reviewer-can answer these question!^ Only 
the classroom teacher and hjs department coUea|;ue$ can supply 
the answers^ and they can only do so by lookmgCarefuUy at the 
actual test questions oni? by one. 

The of nuiking a L'arcful examination ofa test cannot be 
jumplitled very much. It is a tiine-consuming }ob. tt can be more 
effeL^ively accomplished, however, if approached systematically* 
Of>e approach^ applicable primarily lo the selection of an 
achievement test, lollows* 

Th« objeciive of the test analysis is to ascertain (I) what kind 
of maieiiats are included in the test; and (2) the relevance of 
these matc^nals to tlie teaching program*. In order to appraise tesi 
items in a meaningful u'ay. oik should ask of each item: what 
particular skill, understanding^ type of materiaU or subject 
matter docs this item seem to be covering!? Since judgments 
regarding the relevance of an item are necessarily subjective, a 
rough point-value scale for judging relevance should suffice. 
Items considered inconsequential or trivial would be rated 0 to 
\ \ those closely related to local objectives and student capabil* 
ities would be rated 4 or 5. A work sheet ensures that the 
analyjiis is done system at ii:ally* I'our column headings are 
needed: item number, item content, skills involved, and rele- 
vanix; of the item. 

The approach suggested by Melville could be :idapted to 
make determinations of test relevance to curriculum and 
inslructton. The distnct should ensure a sufficient matcli 
between curnculum and instruction by eliminating tests or 
test items that are not sufficiently matched with curriculum 
afid instruction. 



w, James Ptipham, **Customi/i;d Criti;r ion- Referenced Tests." 
EducQtioml Leadership (January. 1977). 258-59. 

^^S. MelvilW. Selecting an Adiievement Test (four-page sum* 
mary adapted from script of film with same titie> available from the 
Cooperative Test Division, (ulucational Testing Service). Princeton. 
N.J,. Educational Testing Service, n.d* 
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Whatever approach is used to determine the extent of 
the match between the test and instruction, the persons 
responsible will have to be knowledgable about the entire 
educational exposure (elementary and secondary levels) of 
the students taking the test. Thus, it will be necessary for 
educators at the elementary and secondary levels to 
cooperate in developing prottciency standards. Cooperdtion 
shotild also be considered in li^t of the new law^ which 
states: "Designated employees of all school distncts located 
within a high school distnct and one or more destgriees of 
tlte high school distnct shall n«et prior to June 1, 1979, to 
plan for articulation of elementary and high school profi- 
ciency standards, and as necessary thereafter to review the 
efTecttveness of such articulation procedures^* (Education 
Code Section 51215). 

A sound approach to instructional validity would not 
rely exclusively on the subjective judgments of a panel of 
administrators or teachers about whether specific test items 
were tauglit in the district's classrooms. These judgments 
should be supplemented with and supported by comparisons 
of test items iind evidence of district curriculum and 
instruction* Such comparisons would include evidence such 
:is curriculum gpides, textbooks and materials used in the 
classroom, lesson plans, student homework samples, and 
perhaps inteiviews with selected students and teachers, A 
school district concerned about the instructional validhy of 
its assessment procedure mi^t want to arrange for an 
outside agency to examine such evidence and prepare a 
report of its findings and conclusions prior to final approval 
of the assessment procedure. 

It should also be emphasized that districts are not 
limited to the traditional paper <and-pencii lest. The new 
law simply states lliat llie proficiency standards **sliall be 
such as will enable individual achievement to be ascertained 
and evaluated" Education Code Section 51225, which was 
added by the new law, also provides: 

The governing board, with the active involvement of parents, 
adminislrators. teachers, and students, shall. b>' January L 1979, 
adopt alternative noeans for students; to complete the pre^ribed 
course of study, which may include practical demonstration of 
skills and competencies* work experience or other outside school 
experience, interdisciplinary study, independent study, and 
CTCdit earned at a po.stsecondary in!;titution. 

JusI as "pmclical demonstration of skills and compe- 
tencies" may be appropriate for the prescribed course of 
study, so too practical demonstration of proftciency skUls 
may be an appropnate and even preferred assessment 
procedure. For example, if the purpose ofa proftciency test 
is to measure a sludent^s ability to perform adequately in 
certain reaMife situations, an applied performance measure 
may be more accurate than a paperand-pencil test* 

Madaus and Atraiiian wnte that many of the minimal 
cognitive competencies for graduation involve application 
of basic literacy and numeracy skills to reaMife situations 
(for example, checking the accuracy of bills and sales slips, 
using the public library, using the town and state offices)* 
"These competencies are most validly measured by the 
most direct means possible^ situational or performance 
examinations which determine if the student can actually 
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perform the behavion/'*' Although they tecognize that 
direct measurement is often costly and time-consuming, the 
two authon conclude that "indirect paper^nd-penctl tests, 
measuring knowledge about the competency areas, are not 
enough. Any indirect, or surrogate, measurement must be 
validated against direct performance measures."^** Serious 
questions about fairness and legality could be raised if a 
student could show that he or she was denied a diploma on 
the basis of performance skills that he or she could 
demonstrate by direct assessment but not by the indirect 
paper-and-pencil method* This problem also suggests that if 
a student cannot pass a paper-and-pencil proficiency test 
adopted by the school district, then the district may want 
to give that student a direct performance measure to be 
sure that he or she does not have the requisite skills before 
denying him or her a diploma* 

Fie1d*testing of the proposed test can serve several 
important purposes (see pag^ 111*13), including determina- 
tion of its likely effects on blacks, Hispanics, and the 
student population as a whole* If substantial or dispropor* 
donate numben of students in any category cannot pass 
the proposed test, the district may want to take another 
look at the adequacy of the match between the test and 
instruction in the district's classrooms and at the reason* 
ableness of its proposed cutoff score* Where limited- and 
n on -English-speaking students have difficulty with the field 
test, the district should give the test in the student's native 
language in order to determine ^A^iether the student's 
difficulty on particular test items is with language or the 
dcills measured by the items. Although the law (Education 
Code Section 51216) requires the formal assessments to be 
given in English, it also permits native language assessments 
for diagnostic purposes: such assessments can be used to 
help provide low-scoring students with appropriate remedial 
instruction before the final assessment in English. 

As mentioned above, the central feature of the new 
Califomia proficiency law is the broad discretion given to 
each school district to determine its own educational goals, 
performance objectives, assessment procedures, cutoff 
scores, and so forth* This broad discretion, of course, 
carries with it a corresponding responsibihty to design 
within the statutory framework a proficiency program that 
is fair to all students in the district. 

Some Cbncluding Cautionary Notes 

The suggested two-phase Implementation procedure rests 
on a number of legal and policy conclusions discussed in 



G, Mad;ius 4nd P, Aimbn, "Issuer; in Kvaluatinf; Student 
Outcomes in Com potency* Based Gradualion Pro^ranis/' Jourtutt of 
Researcft and 0€velo\ytn€nt m Eiiuvation fSprinp, 1977), 86, 



this article. Perhaps the most important of these con- 
clusions are the following: 

• The need for some kind of match between test and 
instruction (instructional validity) 

• The importance of the distinction between measures 
of basic lite racy /numeracy dcills and adult-life skills 

The two*phase implementation procedure will not seem 
compelling to readen who disagree with the rationale 
presented in support of these conclusions* 

For those readen who agree with the concltisions and 
supporting rationale, the two*phase implementation proce* 
dure will help to ensure fairness for all students and will 
thereby reduce the risk of legal challenge* This approach by 
itself, however, cannot resolve all concerns about faimess 
and legality. The most seriotis of these concerns is the 
potential discriminatory effect of the new proficiency law 
oTi racial and linguistic minorities in many Califomia school 
districts* These and other problems affecting students 
regardless of racial and linguistic background raise seriotis 
questions about the need to amend the law to account for 
these problems* With or without statutory amendment, 
districts will have to be especially sensitive to the potential 
for racial and linguistic discrimination when developing and 
implementing proficiency assessment programs. 

The minimal proficiency /competency requirement as a 
prerequisite to a high school diploma is a new phenomenon 
in most states* Therefore, with the exception of racial and 
linguistic discrimination, it is difficult to identify the 
strongest legal arguments for or against it. It is even more 
difficult to predict the judicial response. The potential for 
unfaimess, however, combined \Aih the severe nature of 
the penalty (which, in effect, might condemn a student to 
second-class citizenship) makes legal challenge likely and 
makes special care by school districts essential* 

In conclusion, the persons responsible for developing 
proficiency standards in any California school district may 
want legal counsel to review the approach to be proposed 
to the goveming board* If the approach differs from the 
one suggested in this article, they could ask legal counsel to 
review this article and the article ''Competency Testing'* 
(see page K-2) and form an opinion as to the Ukelfhood and 
seriousness of legal challenge, if the proposed approach is 
the kind of two*stage procedure recommended in this 
article, they could ask legal counsel to review the proposal 
with reference to this article as well as "Competency 
Testing*" This use of "Competency Testing" (or other leg?il 
analyses, if available) is recommended because leg^l counsel 
should be able to form an opinion faster (thtis less 
expensively) if he or she can consider the research 
undertaken, issues identified, and opinions formed by other 
lawyers* 



K-8 



92 



L Setting Differential Standards 



The proficiency provisions added to California's 
Education Code by Assembly Bill 3408 (Chapter 
856, Statutes of 1976) and Assembly Bill 65 
(Chapter 894, Statutes of 1977) require that all 
school districts adopt standards of proficiency in 
the basic skill areas of reading comprehension, 
writing, and computation. As a result of this 
legislation, subsequent to June, 1980, students 
may receive a high school diploma only after 
demonstrating proficiency up to the locally 
adopted standards. 

Beginning in 1978*79 for secondary grades, and 
in 1979-80 for elementary grades, the progress of 
students toward meeting proficiency standards 
shall be assessed at least once in grades four 
through six, once in grades seven through nine, and 
twice in grades ten through eleven. Once a student 
has met the prescribed standards for graduation 
from high school, his or her progress need not be 
reassessed « 

The purpose of the proficiency legislation was 
threefold: to create a public dialogue regarding 
high school graduation standards^ to restore mean* 
ing to the high school diploma, and to encourage 
schools to focus early attention on pupils who are 
having problems in the basic skill areas. While the 
intent of the law was to ensure that pupils 
graduating from high school demonstrate mastery 
of the basic skills necessary to function effectively 
in an adult society, the Legislature recognized that 
a single local standard of proficiency might not be 
appropriate for all pupils (see Section I of the 
Technical Assistance Guide for Proficiency Assess- 
ment for a complete analysis of CaUfomia*s profi- 
ciency statutes). 

Reflecting this intent, additional features of the 
law include the involvement of the community in 
the setting of local standards, a requirement that 
districts make available to students alternative 
means to complete the prescribed course of study, 
and a district option to set "differential standards" 
for some special education pupils with diagnosed 
learning handicaps or disabilities. 



Sections 42 and 43 of AB 65 included an 
extension of proficiency assessment requirements 
into the elementary grades to facilitate early 
identification of p^apils needing remediation in the 
basic skills. To link pupil objectives for the 
elementary grades to Uie secondary graduation 
standards, elementary and high school districts are 
required to meet to articulate their standards. 

Elementary and unified districts also have the 
option to set differential standards for eligible 
pupils in the elementary grades. The consequences 
of not adopting differential standards for special 
education pupils at the elementary level are not so 
great as the consequences of not adopting such 
standards at the secondary level. However, re- 
quiring all special education pupils to address the 
regular elementary standards will have important 
implications for instruction and may constitute 
unfair treatment of some pupils. Therefore, dis* 
tricts are urged to consider carefully the adoption 
of differential standards for pupils in elementary 
grades as well as the need to articulate these 
standards with those adopted for students in 
secondary grades. Whatever the district determina- 
tion, special education pupils and their parents 
should be informed as early as possible and kept up 
to date on pupil proficiency standards in the basic 
skills and likely performance requirements for 
graduation. 

This appendix has three purposes: (I) to de- 
scribe the statutory changes set forth in AB 2043; 
(2) to explore district options and responsibilities 
for the setting of differential standards (including 
some suggestions for determining a pupil^s eligi* 
bility for differential standards); and (3) to clarify 
the requirements in AB 1250 and AB 3635 
pertaining to alternative means of instruction and 
modes of assessment for special education pupils. 

In 1974 the Legislature, through Assembly Bill 
4040 (Chapter 1532, Statutes of 1974), directed 
the Department of Education to develop and 
implement the Master Plan for Special Education 
for the state* The Legislature modified and ex- 
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tended the Master Plan through Assembly Bill 
1250 (Chapter 1247, Statutes of 1977), which 
called for a four-year phase-in period for statewide 
implementation of the plan. In 1978 the Legisla- 
ture passed Assembly Bill 3635 (Chapter 402, 
Statutes of 1978) which modified some of the 
program requirement provisions of AB 1250, 

On September 19, 1978. the Governor signed 
Assembly Bill 2043 (Chapter 893, Statutes of 
1978). which included substantial changes in the 
proficiency provisions of the Education Code 
relating to the setting of differential standards for 
pupils with diagnosed learning disabilities. 

To help school districts undentand their options 
and responsibilities toward pupils enrolled in 
special education programs, a comparative analysis 
of the Education Code sections relating to profi- 
ciency assessment for special education pupils is 
provided in the chart "Comparative Analysis of the 
Proficiency Provisions of AB 65 and AB 2043 and 
the Related Instructional Provisions of AB 1250 
and AB 3635 as They Relate to Special Education 
Pupils." found on page L-3- The analysis contains 
the text of each section of the Education Code 
concerning proficiency requirements for pupils in 
special education programs. Also included is an 
explanation of the contents of the code sections 
and the modifications that have been made to 

them, , , ^ . 

Local Option to 

Establish Differential Standards 

A key feature of California's pupil proficiency 
law is the requirement that the adoption of 
proficiency standards and assessment measures be 
the responsibility of each school district's govern- 
ing board. This provision reflects the Legislature's 
view that the school district is the most appro- 
priate level for setting proficiency standards, 
course requirements for high school graduation, 
and differential standards for pupils with diagnosed 
learning handicaps or disabilities. The following 
section contains clarification of the differential 
standards option in three areas: 

• WHO is responsible for providing differential 
standards? 

• FOR WHOM may differential standards be 
written? 

• HOW are differential standards written? 

WHO is Responsible for Providing DifTerenttal Standards 

First, the school district governing board has the 
responsibility to determine whether or not differ- 
ential standards will be provided* Second^ the 
board is responsible for defining, within the con- 



text of the law, for which pupUs differential 
standards may be written. Technically, the board 
has the option of defining differential standards by 
groups of handicapping conditions rather than on 
an individual basis (see discussion under "FOR 
WHOM Differential Standards May, Be Written")- 
Third, the board has the option of defining the 
specific content of local differential standards. 
However, once the board makes the decision to 
provide for differential standards, it seems most 
advisable to delegate the task of defining for whom 
such standards are needed and the content of the 
standards to either the district or the school special 
education assessment teams^ which are likely to be 
most knowledgeable about special education pupils 
and available services in the district. If the govern- 
ing board desires complete districtwide consistency 
in setting individual differential standards, the 
district-level special education assessment team 
may be the most appropriate group to identify 
eligible pupils and write differential standards* 

Whether the governing board acts itself or 
delegates the development of differential standards 
to the district-level or school special education 
assessment teams, the legislative intent is that the 
differential standards be determined owdwindmdr 
iml basis. 

Districts may conceivably choose to set "group" 
standards for pupils with similar disabilities. How- 
ever, a group approach to establishing standards for 
handicapped pupils is iikely to be inequitable since 
disabilities are not uniform even among persons 
with the same type of handicap* Because of the 
individual needs of pupils, actions which treat 
those needs too similarly may be viewed as 
arbitrary. Further, individual determinations are 
consistent with the Individualized Educational 
Program (lEP) mechanism provided for in the 
California Master Plan for Special Education." The 
Department of Education recommends individual 
determinations for establishing both pupil eligi- 
bility for differential standards and the content of 
such standards. 

Districts that choose nof to set differential 
standards for pupils enrolled in special education 
programs should make provisions to ensure that 
those pupils have been given a reasonable and 
equitable opportunity to demonstrate proficiency 
in the district's regularly adopted standards* Con- 
sideration should also be given to the fairness of 
setting what may be unrealistic expectations for 
special education pupils who, even with intensive 
remediation activities, are not likely to meet the 
district's regular standards. 
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PH)ficicncy provtsions rebting to special education pupils 


Related instructional provisions 


AB 65 


AB 2043 


Atialysis 


AB 1250 as amended by AB3635 


Analysis 


SI 215. ... Dtffmntiat stan* 
danb and assessment pnicediim 
may be adopted for pupils with 
diagnosed learning dtubilities. 
(Repealed by aB 2043) 

{For the complete text and 
an analysis of the proHciency 
provisions of AB 65^ see Section 
1 of the Technical Assistance 
Guide for Profidency' Assess- 
ment-] 


51215. Differential standards 
and assessment procedures may 
be adopted for pupils who: 

(a) Arc enrolled in special educa- 
tion programs pursuant to Fart 
30 (commencing with Sec don 
560001. and [emphasis added | 

(b) Have diagnosed Icamif^ 
handicaps or disabilities that 
would preclude them from 
attaining the district's regular 
proficiency standardls with 
appropriate educational services 
and support. 

Any such differentia) stan* 
dards shall be mcluded in the 
individualized education pro- 
gram developed for the pupil 
pursuant to Part 30 (com> 
menctng wjth Section 56000). 
For ptuposes of this section* the 
definition of pupDs with dtag: 
nosed leamutg handicaps or dts- 
abilities is not limited to pupils 
identified pursuant to sections 
56600. 56601 * or 56302. 


AB 65 

For an anal>sis of lite iiroH* 
dcnc)' provisions of AB 65. sec 
Section I of the Tahnicat Assis* 
tatice Guide. 

AB 204,; 

Section 14 of AB 204JI 
Jin ended Educatiuii Code 
Section 51215 lo clarily the 
dcHuiiion of |>upih for wfium 
diftercntial standards may be 
provided. The major clianucs 
from ihe AB 65 require nicJits 
are as follows: 

• Reieniion of the local upiion 
to set differential standards 

• Limitation uf ihc availability 
of differential standards to 
pupils enrolled in special cdu* 
cation prugiains 

• Expansion of the dcfiniiion 
of diagnosed learning handi* 
caps or disabilities beyond 
the category of "learning dis- 
abled^* exceptionality to in* 
elude special education pupils 
whom the district has identic 
Hed as unable to meet the 
district's regular proficiency 
standards as a result of a 
learning handicap or dis* 
ability 

• Mandatory inclusion of the 
diflc rcntial standards, if 
esiabtislied. in the Individ- 
ualized liducational Program 


S6336.5(cK A sctondary* grade 
level pupiPs individualized edu< 
cation program sliall also include 
any alternative means and modes 
necessarx' tor the pupil to conv 
pleie t])c district's prescribed 
ciiurse of study and meet or 
exceed proficicncv^ standards for 
graduation, in accordance with 
sections 51 12S and 51225.5* 


The California Master Han 
for Special Education (AB 1250) 
nftfttireS that special education 
pupils in Master Plan districts bo 
provided with alternative means 
and modes necessary to vom- 
)ilcte the prescribed course of 
study and d^mojistraic profi* 
cicnc>^ in the district^ regubr 
proHcicncy standards. As noted 
above, local governing boards 
also have the option to ]>rovidc 
differential standards lor sonie 
sjKcial education pupils. These 
standards will be mo si appro< 
priaicly dt^tmed on an individual 
basis, along with procedures for 
instruc:ion (mean^) and asscst^ 
nicnt ;modes) within the Indi< 
viduali/ed Educational Program, 



*TheTe ii an ippuent error in Section 56336,5(c> of AB I25Qai amended by AB 3635 sin^^ the sociion CQnijins the icTcrrriLc t(> 
Section 51225.5, which was repealed t>y AB 65. The lefeience should be to Section 51215. which AB 65 udded lo the I ducitiion 
Code, Thaefoie. i dhttkt*i prescribed course of iiudy and standards of proficteno' in ihc bjsic skills should be in ^c^^rd with 
Section 51225 (coMise of mdy) and Section 51215 fpioficiency itandardiK 



FOR WHOM May Diflerential Staodflids Be Written? 

As mentioned earlier, recent amendments to the 
Education Code clarify the criteria for identifying 
pupils for whom differential standards may be 
provided. Both of the following criteria must be 
inet by each pupil: 

L Enrollment in a special education program 
pursuant to Part 30 (commencing with Sec- 
tion 56000) of the Education Code 
and 

2. Identification as having a "diagnosed leaniing 
handicap or disability" that would preclude 
the pupiPs attaining the district's regular 
proficiency standards with appropriate educa- 
tional services and support. 

The Hist provision, requiring that a pupil be 
enrolled in a special education program to be 
eligible for differential standards, limits the avail- 
ability of differential standards to students who 
have been assessed by the local special education 
team and are currently receiving services, 

The second provision reflects the intent that the 
identification of special education pupils eligible 
for differential standards be made, as much as 
possible, on an individual basis rather than a group 
basis in accordance with the traditional funding 
categories of "learning disabled," Rather than a 
narrow technical defmition, the Legislature sought 
to provide a practical definition based on whether 
or not a pupil's diagnosed learning handicap or 
disability would preclude his or her attaining the 
district's regular standards with appropriate se^ 
vices and support. As mentioned in the compara- 
tive analysis, for purposes of this section, the 
definition of pupils with diagnosed learning handi- 
caps or disabilities is explicitly not limited to 
pupils identified pursuant to sections 56600, 
56601, or 56302 of the Education Code. Special 
education pupils who are integrated into the 
regular program for part or all of the t^ay are also 
eligible for differential standards. 

In making a determination of whether students* 
diagnosed learning handicaps or disabilities are 
^'such as would preclude them from attaining the 
district's regular proficiency standards" the local 
assess ment team is offered the following 
recommendations: 

1. Examine the pupil's most recent annual 
assessment. What has been the pupil's general 
academic and personal growth pattern? What 
is the pupil likely to be able to attain by the 
end of his or her senior year in high school? 



1 Examine the districf s regular proficiency 
standards and passing scores. Are the district 
standards likely to be attainable for the pupil? 
If so» the pupil should be given the oppoi^ 
tunity to demonstrate proficiency in the 
district's regular standards. If the assessment 
team is uncertain^ the special education pupil 
might be administered the district's regular 
tests to determine the need for differential 
standards or assessment procedures. 

3. Given the amotuit of time before the pupil's 
proposed graduation date and the regular and 
special educational services that the district is 
able to provide during that period, determine 
the likelihood that the pupil will have a 
reasonable opportunity to meet the district's 
regular standards. 

Differential performance standards are subject 
to revision when the pupil's needs are reviewed at 
the annual assessment. Even if differential stan- 
dards are established, the pupil and his or her 
parents need to be informed of the pupil's right to 
attempt the district's regular standards without 
forfeiting the right to meet the differential 
standards. 

How long may differential standards be main* 
tained? In keeping with the philosophy of special 
education services, some pupils, for example, may 
elect to leave special education services to partici- 
pate in a Regional Occupational Program (ROP), a 
sheltered workshop, or a similar program. If a pupil 
is removed from special education services to enroll 
in another program, maintaining the differential 
standards may be appropriate, provided that the 
differential standards were written while the pupil 
was receiving services. 

On the other hand, students should not be 
^'cycled through" special education assessment to 
qualify for differential standards and then be 
retunied to the regular program. Instead, in keep- 
ing with the Master Plan's philosophy of educating 
the pupil **in the least restrictive setting," learning 
disabled pupils who have been identified as eligible 
for differential standards should not be penalized 
for moving out of special education programs by 
being required to demonstrate proficiency in the 
district's regular standards. The final Individualized 
Educational Program (lEP) of such a pupil should 
reflect the fact that the differential standards wilt 
be maintained through high school graduation. 

The chance always exists that some low- 
achieving pupils who are not enrolled in special 
education programs will be unable to demonstrate 
proficiency in the basic skills up to the district's 
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adopted standards. The pupil proficiency law 
requires early identification of pupils not 
demonstrating proficiency, a conference with the 
pupils* parents, and focused remediation activities. 
7b best serve the low^chieving pupil who is not 
enrolled in special education services, districts are 
strongly advised to begin diagnostic assessment in 
the early elementary grades and to provide re- 
medial instruction as soon as possible for pupils 
who do not demonstrate sufficient progress toward 
proficiency. 

Special education pupils, like other pupils, must 
be given adequate notice of proficiency standards 
they must meet to receive a diploma; Further^ 
special education pupils for whom differential 
standanls have been provided early in their high 
school career but who elect to be released from 
special education services (for example^ to enter an 
ROP program) should remain eligible for a continu* 
ation of their differential standards^ as long as the 
local team has documented the need. 

HOW Are Diffeiential Standards to Be wHtten? 

Differentia] standards are pupil proficiency stan* 
dards that are different from the districtwide 
proficiency standards required by Section 43 of 
AB 65. While all pupils should be given the 
opportunity to demonstrate proficiency in the 
district's regular proficiency standards, those stan* 
dards may not be appropriate for all pupils. 

For many special education pupils, the regular 
proficiency standards will not be appropriate. The 
content of the differential standards, like the 
eligibility for such standards, will be most easily 
defended if they are determined on an individual 
basis. The suggested guidelines for identification of 
pupil need for such standards should also apply to 
the development of the content of the standards. 

Those responsible for writing the standards 
should review the pupil's educational history^ 
determine the amount of time remaining before 
projected graduation from high school^ and iden- 
tify the special education services and support that 
a pupil is currently receiving and is likely to 
receive. 

Districts may first want to examine the regular 
proficiency standards. What are the skills a pupil is 
required to master enroute to mastery of the 
district proficiencies? By conducting a "task anal- 
ysis^' of each of the district's regular competencies 
and measures, the enabling, or enroute, skills can 
be identified. The district may combine these 
enabling skills with appropriate measurement pro^ 
ceduies to produce appropriate differential stan- 
dards* As the pupil demonstrates progress toward 
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proficiency in the enabling skills, the local team 
may suggest that the pupil meet the district's 
regular proficiency standards. 

If students are not likely to master traditional 
academic skills, or even subskills of the regular 
proficiencies, the district may wish to consider 
defining differential standards that employ "real- 
life'* skills. For example, instead of requiring 
mastery of enroute reading and writing profi- 
ciencies, the differential standards may require the 
pupil to demonstrate understanding of oral instruc- 
tions or to demonstrate the ability to ride public 
transportation without seeking adult assistance. 

The differential standards are likely to take the 
form of one of the following: 

• Modifications of the regular standards 

• A combination of enabling skills for the 
regular standards 

• A lowered passing score on the regular 

measures 

• An entirely different set of standards and 
measures 

The most useful and defensible performance stan- 
dards contain specific definitions of the conditions 
under which the pupils^ skill attainment will be 
measured. In addition^ they should contain a 
definition of the type, content^ and anticipated 
level of pupil performance for each designated 
area. The more specific the criteria, the easier it 
will be to judge a pupil^s performance' and to 
evaluate and revise the standards, if necessary. 

The provision of a written Individualized Educa- 
tional Program (lEP) is a major component of the 
California Master Plan for Special Education (AB 
1250) and PL 94-142, the Education for All 
Handicapped Children Act of 1975. The lEP is 
written jointly by school staff, the pupiPs parents, 
and, when appropriate, the pupil. The plan is 
developed after assessment of the child's individual 
capacities by a specified team of certified school 
personnel and the pupiPs parents. 

For districts that choose to provide differential 
standards, the standards must be included in the 
lEP. By requiring the incorporation of differential 
standards in the lEP, the Legislature again empha- 
sized the need for determination of individual 
rather than group, performance standards. The 
requirement for individual assessment of special 
education pupils and of an annual reassessment 
provides the mechanism for determining whether 
the special education pupil, in fact, meets the 
performance criteria. 

In the development of an lEP for an elementary 
pupil, local teams are encouraged to consider both 
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the long-term capabilities of the pupil as well as the 
annual instructional objectives. Criteria were sug- 
gested in the previous section for assisting the team 
in determining which pupils qualify for differential 
standards. A well-written lEP for elementary pupils 
will also help the secondary personnel who are 
responsible for documenting the pupils' profi- 
ciency for graduation from high school 

Districts must ensure that the skills that the 
curriculum and instruction are designed to cover 
match the skills needed to meet the proficiency 
standards. Failure to ensure such a match may 
result in legal problems since pupils whose skills do 
not meet the standards will be denied high school 
diplomas.* Whenever possible, differential standards 
should closely reflect the district's regular profi- 
ciency standards. Whether the district adopts aca- 
demic skills or real*life skills as differential stan* 
dards, the curriculum and instruction to which the 
pupils are exposed must reflect the type of 
standards and measures used to determine profi* 
ciency for graduation. 

Each special education pupil in California is 
required to have an lEP, which forms the basis of 
the pupil's learning experience because it contains 

(1) the objectives for the pupil's achievement; and 

(2) the services the district will provide to the 
pupiK In Master Plan districts the secondary 
student's lEP must also include the means of 
instruction and the modes of assessment for 
completing the district's regular proficiency re- 
quirements. Although required only in Master Plan 
districts, the Department recommends that the lEP 
of all special education pupils include the proposed 
means of instruction and the mode for assessing 
the pupils* attainment of whatever proficiency 
standards are required. 

Differential Modes of Assessment 
and Means of Instruction 

The mode of assessment is the method by which 
an individual pupil's progress toward a stated 
standard is medsured. The means of instruction are 
the techniques used to teach a pupiL The Master 
Plan requires, when appropriate, provision of alter- 
native modes of assessment and means of instruc- 
tion to allow special education pupils to receive 
instruction and demonstrate proficiency in a dis^ 
trict's regular proficiency standards. While non- 
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Master Plan districts have the option to provide 
differential standards of proficiency ^and modes of 
assessment for special education pupils^ Master 
Plan districts are required to provide differential 
modes of assessment and means of instruction 
necessary for pupils to meet proficiency require- 
ments. 

The most typical mode of assessment used in 
schools is the pencil-and -paper test. Other modes 
of assessment include oral measures, simulated 
performance measures, and direct performance 
measures. Allowing the student to respond to 
questions orally, reading the test to a pupii and 
allowing the pupil to respond on a typewriter, 
extending the normal time limit, or asking the 
pupil to perform a task and rating him or her 
against stated criteria all constitute differential 
modes of assessment. 

Differential modes of assessment of pupil prog* 
ress toward the district's regular proficiency stan* 
dards may be used for any student, not just for 
these in special education programs. The only 
stipulation in using a differential mode of assess- 
ment is that it be designed to measure accurately 
and reliably the same skills at the same level as the 
corresponding area of the district's regular profi- 
ciency assessment measure. 

For some special education pupils, the use of 
alternative modes of assessment to address the 
regular standards will suffice. However, for other 
pupils an alternative mode of assessment may not 
be enough. For those students districts may wish 
to provide differential proficiency standards as well 
as differential modes of assessment and means of 
instruction. 

Summary 

The intent of the pupil proficiency provisions in 
the Education Code is to ensure that students 
graduating from high school will demonstrate 
proficiency in basic skills necessary to further 
success in school and in adult life. The provision 
for "differential standards** is included because the 
Legislature recognized that pupils with diagnosed 
learning handicaps or disabilities may not be able 
to meet the district's regular proficiency standards. 

For pupils in special education programs, the 
law gives governing boards the option to establish 
differential standards of proficiency. The local 
board must decide initially whether to provide 
such differential standards. Having decided to do 
sOj the board must then develop a procedure for 
identifying pupils who will be eligible to be judged 
by such standards. 
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• The language of the law reflects the legislative 
intent that boards adopt a broad definition of 
"learning disability" for prescribing differential 
standards. A board should designate the local 
special education team to identify pupils "having a 
diagnosed learning handicap or disability such as 
would preclude them from attaining the district's 
regularly adopted proficiency standards " The local 
team is likely to be in the best position to make 
individual determinations regarding a pupil's need 
for differential standards and the specific content 
of the standards. If a differenMal graduation 
standard is recommended, graduation performance 
requirements must be included in the lEP, 

The setting of differential standards by an 
elementary district should also be part of the 




articulation process between the elementary and 
the high school districts. Once a district makes a 
determination of need for a differential standard^ 
the Department recommends that parents and 
pupils be kept informed of pupils' progress and 
their option to try to meet the district's regular 
proficiency standards without losing their eligi- 
bility to be assessed in relation to the differential 
standards. Finally, boards that elect not to provide 
differential standards will need to give special 
attention to ensure that special education pupJs 
have a reasonable and equitable opportunity to 
demonstrate proficiency in relation to the regular 
standards. 
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M Bias and Fairness in Proficiency Assessment 



Tile purpose of this paper is to assist school 
districts in understanding the issues of t^i^s and 
fairness in proficiency assessment procedures, 
specifically as these procedures relate to pupils of 
diverse cultural, racial^ and linguistic backgrounds. 
While the suggestions provided should help districts 
avoid bias in proficiency assessment, the State 
Department of Education cannot, of course, guar- 
antee that following the recommended steps will 
ensure districts legal protection in this regard. 

Background 

In September of 1976 the California State 
Legislature passed Assembly Bill 3408, requiring 
that all districts maintaining secondary schools 
adopt standards of proficiency in the basic skill 
areas of reading comprehension, writing, and com- 
putation. As a result of this legislation, subsequent 
to June, 1980, no student may receive a high 
school diploma without demonstrating proficiency 
in the skills for which the district adopts standards. 

In September of 1977 Assembly Bill 65 ex- 
tended the provisions of AB 3408 by requiring that 
districts maintaining elementary schools adopt 
standards of proficiency that are articulated with 
those of the appropriate secondary school and that 
students' proficiency be assessed in relation to 
these district-adopted standards once in srades four 
through six* once in grades seven through nine, and 
twice in grades ten through eleven. For ^ student 
having difficulty meeting these standards^ a confer^ 
ence is to be held, involving the principal, the 
teacher, the student's parents, and, where appro- 
priate, the student to discuss the results of the 
assessment and to describe the required supple- 
mentary instructional program. An additional 
feature California's proficiency law includes the 
involver^ent of teachers, students, parents, and 
other community members in the setting of local 
standards. 

While California's proficiency assessment law 
was designed with the intention of ensuring that 
students demonstrate proficiency in basic skills^ it 



was not meant to preclude students* obtaining 
diplomas. The provisions of AB 65 requiring 
periodic assessment, parent conferences, and 
remedial instruction in basic skills are all proce- 
dures designed to ensure that each student is 
afforded every opportunity to meet the require- 
ments for obtaining a high school diploma. 

Many educators are concerned, however, that a 
disproportionate number of minority students may 
not be able to meet the district-adopted standards 
of proficiency. If they are not able to meet the 
standards, several questions arise: (1) ''Is a dis- 
trict*s proficiency test biased?" (2) "How can one 
determine whether it is biased?" (3) "If it is biased, 
what can a district do about it?" A further 
question that should be asked is whether or not ^ 
proficiency test, as it is being used, is '"fair," 

This paper contains a discussion of both test bias 
and test fairness, specifically as they relate to 
proficiency assessment, and a description of two 
approaches to identifying test items that may be 
biased. It should be emphasized that the problems 
involved in avoiding bias and unfairness in testing 
are complex and difficult and that at this time 
there are no clear-cut solutions to the problem. 
Districts can, however, take reasonable steps to 
avoid bias and ensure fairness; this paper is 
designed to offer suggestions to assist in the 
process. The following sections contain definitions 
of both bias and fairness as they relate to profi- 
ciency assessment. 

Bias 

Bias in testing is defined in several ways because 
there is no consensus on a single "correct'* defini- 
tion- The definition of bias which seems most 
appropriate to proficiency assessment and which 
will be used throughout this paper is as follows: 
"An item of a test is said to t« biased for members 
of a particular group if, on that item, the members 
of the group obtain an average score which differs 
from the average score of other groups by more or 
less than expected from performance on other 
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items of the same test."* In other words, a biased 
test item is one that contains a cliaracteristic that 
causes one group to respond differently to that 
item than would another group. An example is the 
following test item: 

What would you use to measure water for 
making one serving of instant soup? 

A. A teaspoon 

B. A quart 

C. A measuring cup 

D. A gallon 

"One serving" to most people in the m^ority anglo 
culture would mean approximately one cup or the 
amount that would be consumed by a person at a 
meal. However, for some "Spanish-speaking persons 
"one serving" may mean One mouthful or one 
spoonful. In responding to the test item, Spanish- 
speaking students might select the **wrong" re- 
sponse option because of a difference in cultural 
background rather than a lack of understanding of 
units of measurement. A later section of this paper 
contains suggestions for a procedure to use in 
identifying and revising biased test items. 

There is another deflnition of bias, which is not 
considered appropriate for use in proficiency test- 
ing. According to that definition, any test that 
results in a systematic difference in scores among 
groups is biased. If one were to use this definition 
of bias, all tests would be biased because some 
group will always score systematically lower than 
another group. Consider, for example, a situation 
in which a district has identified and revised or 
deleted biased items from its proficiency test and 
students from minority or low-income groups still 
sct)re systematically lower than do students from 
middle- or high-income groups. This difference in 
scores may . not be the result of biased test items 
but rather the effect of a history of differential 
treatment and opportunities afforded persons from 
low-income or rrunority groups. 

This systematic difference in scores among 
groups may indicate that for a variety of reasons, 
the educational system has not been successful in 
meeting the academic needs of some segments of 
the student population. To claim that the problem 
hes solely with the tests is to imply that minority 
students indeed are proficient in the basic skills 
and the tests are simply not reflecting this profi- 
ciency. The following section contains a discussion 
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of how a test can be used fairly even when there is 
a systematic difference in scores among groups. 

Fairness 

Whereas bias refers to how a test is constructed, 
fairness refers to how a teit is used. Even though 
values and judgments enter into estimates of 
fairness, decisions regarding the fair use of a test 
must be made irrespective of the presence or 
absence of bias. Before the discussion of fairness in 
proficiency tests, two examples are provided to 
clarify what is meant by test fairness. 

Example 

A test f'or u contractor's license favors those with 
experience and training in construction. Persons who do 
not haw experience and training in construction will not 
perform as well on this test as those who do. This test is 
biased because it is more diflficult to pass for those 
without experience; however, it is used fairly. On ihe 
other hand, if minorities do not do as well on the test 
because of closed unions that deny them the experience 
to compete equally, then using this test to grant 
contractor's licenses is unfair. 

Example 

A test of computation skills is used to determine 
which students >vill be required to take a remedial math 
class. The test contains items designed to measure 
consumer math skills. Students in grades six and seven 
perform poorly on the test because consumer math is 
not taught until grade eight. It is also not tatight in the 
remedial course. Unless these consumer math items are 
deleted from the test or unless students are taught 
consumer math prior to taking the test, using the tesNo 
determine who is required to take a remedial math 
course would be considered an unfair use of the test. 

It is also possible tliat some students possess the 
computation skills required to pass the test but fail 
because they are unable to read the questions. In this 
event requiring a reir^dial math course would be both 
inappropriate and unfair to the student. An approach to 
overcoming such a problem is to remove the need for 
reading skiUs by either reading the questions to the 
student or otherwise designing the test so that no 
reading is required to understand the questions. 

In attempting to judge the fairness of profi- 
ciency tests, districts must be especially careful to 
distinguish between aptitude and achievement 
tests. An aptitude test is designed to predict an 
individuars potential for future achievement; 
therefore, the questions or items for an aptitude 
test are specifically selected so that they are not 
influenced by instruction. Achievement tests, how- 
ever, are designed to identify what a person does or 
does not know and what skills a person does or 
does not possess. Achievement tests should, there- 
fore, be sensitive to and reflective of instruction. 
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The reason this distinction is important lies in 
the consequences of the interpretation and use of 
the test results. If an aptitude test is used to 
predict a person^s potential, a poor score is an 
indication that any additional educational effort 
might be wasted. However, a poor score on an 
achievement test is an indication that instruction 
has not been successful and that further instruction 
in that area is necessary. In other words» while a 
poor score on an aptitude test may result in a 
limiting of opportunities, a low score on an 
achievement test should result in renewed efforts 
to provide appropriate and effective instruction. 

California's proficiency law requires that dis- 
tricts provide supplementary instruction in basic 
skills for any pupil who does not demonstrate 
sufficient progress toward mastery of these basic 
skills. This assessment and instruction cycle is to 
continue until the pupil has been given repeated 
opportunities to achieve mastery. This use of 
proficiency tests for identifying students' academic 
weaknesses and for providing focused, supplemen- 
tary instruction is unquestionably fair. 

On the other hand, if a disproportionate number 
of minority students are unable to P^ss the 
proficiency tests and are, therefore, denied a high 
school diploma, then the proficiency assessment 
may be carrying forward the effects of prior 
discrimination. In other words, minority students 
may be denied access to many opportunities 
because of unequal treatment in the past. Districts 
that have a history of discrimination should be 
particularly attentive to the suggestions provided in 
the remainder of this paper. 

Final determinations regarding the fairness of 
proficiency assessment may ultimately be made by 
the courts. In the meantime districts are urged to 
make every possible effort to ensure that each 
student has been provided numerous opportunities 
to demonstrate proficiency up to the district- 
adopted standards. The following suggestions are 
provided to assist districts in identifying and 
removing biased items from their proficiency tests 
and in using test results fairly. 

Suggested Steps for Avoiding Bias 
and Ensuring Fairness 

A paper entitled *^Developing Proficiency Pro- 
grams in California Public Schools; Some Legal 
Implications and a Suggested Implementation 
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Procedure'* was distributed to districts by the State 
Department of Education in August, 1978*^ While 
that paper contains a discussion of some legal 
concerns regarding racial and linguistic discrimina- 
tion in proflctency assessment, it also contains ^ 
discussion of steps that districts can follow to 
promote fairness in assessment* Those steps will be 
only briefly outlined here; the reader is referred to 
the original paper for more detail* Additional steps 
for avoiding bias and ensuring fairness are also 
provided below* Some of these steps are required 
by law; others are merely suggestions* Districts 
should be careful to review the legal requirements 
as described in Section I of the Tecfmical Assis- 
tance Guide, (See footnote 2*) 

Step L Give adequate notice regarding new 
graduation requirements. Districts should notify 
students and parents of proficiency standards and 
assessment procedures as soon as possible after 
they are adopted* 

Step 2 Match the skills on proficiency tests 
with those covered in the current curriculum a^d 
instruction* This point is particularly critical. Dis- 
tricts should carefully review their proficiency tests 
to ensure that tlie skills to be measured are accurate 
reflections of the district's curriculum and actual 
classroom instruction* For example, a district may 
believe that it is important that students graduating 
from high school be able to balance a checkbook. 
That district must ensure that the curriculum 
requires teaching students not just basic computa- 
tional skills but the actual task of balancing a 
checkbjok as well* Unless districts can ensure a 
match between instruction and their proficiency 
tests, they may be vulnerable to legal challenge. 
One way of avoiding such a challenge is to 
introduce instruction in the skill into the curricu- 
lum and then to begin assessment of proficiency in 
that skill at a later time, when students have had 
sufficient instruction in the skill* 

One approach to facilitating the assessment- 
instruction match is to involve classroom teachers 
in all phases of the proficiency assessment process, 
particularly in the selection or development of 
tests* The match is further facilitated by providing 
teachers with detailed descriptions of each of the 
competencies measured. Teachers should also be 
provided with instructional materials and teaching 
suggestions keyed to the specific competencies 
measured in the proficiency test* This keying of 
instructional materials to the tests serves a dual 
purpose in that it takes some of the preparation 
burden off the classroom teachers and increases the 
likelihood that they will teach the skills that are 
measured in the district proficiency test* 
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Step 3, Provide inservice training to classroom 
teachers, Inservice training should be provided 
teachers to inform them of the proficiency require- 
mentSf the district's response to the requirements, 
and the seriousness of the consequences for stu- 
dents who fail to meet the requirements. Teachers 
may also need inservice training in teaching or 
reinforcing the skills assessed in the proficiency 
test, particulariy reading skills. Many high school 
teachers in particular have never been taught to 
teach reading and may need help in this area, 
Inservice training in the diagnosis of student 
deficiencies may also be necessary. 

Step 4, Ensure that there is substantial and 
representative community and staff involvement in 
the adoption of proficiency standards. It may also 
be wise to involve parents, community members^ 
teachers, and students in the setting of passing 
scores, (See Section 111 of the Technical Assistance 
Guide for a description of a suggested process for 
community involvement.) 

Step 5, Ensure that assessment devices are valid 
with regard to professional psychometric standards 
and to their match with instruction. If persons 
with technical measurement expertise are not 
available in the district, the offices of county 
superintendents of schools or measurement. consul- 
tants may be able to provide assistance in judging 
test validity. (The reference section of this paper 
contains a list of measurement textbooks for 
districts to refer to in evaluating the psychometric 
quality of their measures.) 

Step 6. Enhance the district's instructional pro- 
gram in the basic skills. The primary purpose of the 
proficiency assessment law is not to prevent 
students from obtaining a high school diploma but 
to ensure that students who are having problems in 
the basic skills are identified and helped. This task 
in the proficiency assessment process may be both 
the most important and the most difficult to 
achieve. 

It is important, therefore, that districts provide 
students with repeated opportunities to receive 
instruction and to demonstrate proficiency in 
district-adopted standards. The proficiency law 
requires these efforts by emphasizing early and 
periodic assessment, conferences with parents of 
students not demonstrating sufficient progress on 
the district proficiency measures, and supple- 
mentary instruction for such students. 

Step Z Reexamine the passing score on the 
proficiency measures. In the Technical Assistance 
Guidet an approach to setting passing scores is 



described. It should be stressed, however, that 
neither that approach nor any other will neces- 
sarily result in a ''valid" passing score. 

Since identifying with certainty what a passing 
score should be is not currently possible and since 
establishing the passing score is crucial in deter- 
mining whether a student receives a diploma, it is 
particularly important that passing score decisions 
be made by a consensus of the participants in a 
community-based process. It is also recommended 
that persons involved in setting passing scores be 
provided with data from the trial administration of 
the test (field test data) that indicate how students 
performed on the measure along with the projected 
number of students who would fail if the passing 
score were set at various levels; for example, based 
on field test results, what number of students 
would fait the proficiency test if the passing score 
were set at 50 percent, 60 percent, or 70 percent? 
This information might be provided for seventh, 
ninth, and twelfth grade students as an indicator of 
how well a district is doing and how much progress 
from grade to grade could be expected if a district 
were to continue operating as it has been. It can 
also give an estimate of what ninth graders^ 
performance might be when they reach the twelfth 
grade level. Such information also provides some 
baseline data with which to compare future efforts 
to improve the basic skills program. Exhibit A at 
the end of this paper is the policy developed by 
one district as an approach to the setting of passing 
scores and is noted here not because of the 
particular scores set but because of the flexibility 
of the scoring procedure. For districts which 
anticipate that large numbers of students will fail 
early assessments, the most defensible and ^Tair^^ 
approach may be to set a passing score that is 
lower than they may wish to set during the first 
year or two of the proficiency assessment process. 
The passing score may then be raised as the district 
improves the effectiveness of its remedial programs 
and hence its ability to bring a greater number of 
students to proficiency. 

Step 8. Document all activities related to profi- 
ciency assessment. Districts should maintain 
records of all meetings, listing school and com- 
munity persons who were involved in the profi- 
ciency assessment efforts. The record should in- 
clude the number of persons involved, their con- 
stituency (for example, parents, teachers, students, 
or other community members), and the way they 
were involved (for example, selecting standards or 
setting passing scores,) 

In addition, districts should be particularly 
careful to document their efforts to ensure a close 
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match between assessment and instruction. Dis- 
tricts developing their own proflciency measures 
should also document test validation efforts. 

Step 9. Administer diagnostic, enroute tests in 
the language the student is most familiar with. 
While all students must demonstrate proficiency up 
to district<adopted standards in the English lan- 
guage to receive a diploma, the law does not 
preclude giving enroute tests in the students* native 
languages. This procedure can be used to determine 
whether poor test performance is due to a language 
deficiency or to lack of proficiency in a basic skill. 
If the district's regular proficiency tests are trans- 
lated into a student*s native language, the tests 
should be reviewed for accuracy of translation by 
speakers of that language. (See Section III of the 
Technical Assistance Guide for elaboration on the 
assessment of limited* and non-English*speaking 
students.) 

Step 10. Avoid speeded tests. Speeded tests may 
increase student anxiety and may decrease the 
accuracy of the responses to test items. The 
primary concern should be to obtain an accurate 
estimate of ^ student's proficiency in the skills 
being tested. Speed is not a critical factor in 
proficiency assessment. 

Step 11. Give students lessons in test-taking 
techniques, and provide numerous opportunities 
for students to practice taking tests or quizzes 
designed to assess their proficiency in the skills 
measured /i the proficiency test. This is not to 
imply that practice should be given on the same 
items but rather in the same skills that are 
measured on the proficiency test. Students should 
also be given practice in taking tests in the same 
format as the proficiency test. Students are more 
likely to be motivated to try to do well on 
proficiency tests if they have been successful in the 
practice quizzes. Therefore, practice quizzes should 
be available for testing even the most basic skills. 
In some cases portions of the proficiency tests used 
in the elementary grades would be appropriate 
practice quizzes for intermediate and high school 
students who are having difficulty with the high 
school version of the proficiency test. 

Step 12. Review tests for biased items, using the 
approaches described in the next section. 

Approaches to Identifying Biased Items 

The identification of biased test items should be 
conducted in two phases: (1) before administering 
the field test, the actual test items should be 
reviewed; and (2) after administering the field test. 



results should be reviewed. Field test procedures 
are described in three California State Department 
of Education publications; the Technical Assis- 
tance Guide for Proficiency Assessment and both 
the secondary and the elementary versions of the 
Sample Assessment Exercises Manual.^ To obtain 
more reliable estimates of the'potential for bias, 
districts should field-test using the largest possible 
sample. Large samples may be difficult for many 
small districts to obtain; therefore, it is suggested 
that small districts collaborate on test development 
and field test efforts if possible. 

Phase 1: A Priori Item Review 

This procedure simply involves looking carefully 
at each test item and trying to determine whether 
the content of the item is either inappropriate or 
biased for the groups of students whose profit 
ciency is being assessed. Inappropriate items a^ 
those that result in measurement of something 
other than what they are designed to measure, A 
simple example is a computation word problem. 
The trait being measured is computation, but the 
assessment of the trait may be complicated by the 
fact that the student is required to read in order to 
respond to the item.JbLis possible that an item is 
inappropriate for all groups. As such the item 
would not be biased but should be deleted or 
revised. However, if the item is especially more 
difficult for one group than another, the item is 
probably biased. Both inappropriate and biased 
items should be identified and eliminated or 
revised. 

Reviewing test items for bias should be con* 
ducted by a committee composed of members who 
are especially sensitive to the concerns of the 
groups they represent. Representatives of the 
following groups might be included: 

# All ethnic and racial groups in the district 

* Males and females who are sensitive to current 
sex-role issues 

* Classroom teachers involved in teaching basic 
skills 

• Student representatives of each of the various 
ethnic, racial, linguistic, and sex groups 

# A person who is familiar with test develop- 
ment procedures. If no one in your district is 
specifically trained in these skills, county 
office personnel may be available, or a test 
development consultant might be brought in 
as needed. 

^SitmpU Assessment Extrdses Manuat (Secondary and elemen- 
tary editionSt two volumes in each), Sacramento, Calif.: State 
Department of Education* 1978, 
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The following is a list of criteria that districts 
might wish to use in attempting to review test 
items for bias. It is important to remember that 
altliough the examples in the list are potentially 
biased* use of them in a test will not necessarily be 
unfair If a district is uncertain, it should admin- 
ister a field test and review the results before 
deciding to delete or revise an item, Tlie district 
may also decide to keep the item and adjust the 
curriculum or the instructional program to include 
more instruction in the area covered by the test 
item, (For information on using test results to 
improve the curriculum, see "Linking Test Resuhs 
to Instruction'' on page M'9,) 

Use familiar experiences. Districts should ensure 
that test items reflect experiences witli which all 
groups represented in the district can reasonably be 
expected to be famiUar, For example* the alter* 
natives provided in the right-hand column in 
Example A are words that represent the class of 
words in the left-hand <iolumn but are more likely 
to be familiar to a variety of ethnic and cultural 
groups than are the words in the middle column 
and» consequently^ will not be as likely to distort 
the assessment of the trait in qiit^stion. 



Example A 



Class of 
intended word 


Avoid using 
tenns sucK as 


Acceptable 
alternatives 


soup 
dog 

oi^upational Utie 
rain shelter 
musical instrumeni 
flower 
color 


vichyssoisc 

malatnute 

veterinarian 

parasol 

Karp si chord 

lotus 

mauve 


potato soup 

German shepherd 

grocery clerk 

umbrella 

piano 

rose 

purple 



Another example is a case in which a student is 
provided with a picture of a dog and asked to \ndi- 
cate the correct initial consonant from among the 
four options and 6- Spanish-speaking chil- 

dren may be more likely to select p because the 
Spanish word for dog is perro. 

In trying to answer the question in Example B, 
persons who have not worked with office materials 
may not be familiar with such items as a paper 
fastener and would^ therefore, have difficulty 
identifying the appropriate unit of measure. More 
common items might be a pencil or a table. 

Example 6 

The drawing below represents a paper fastener. What 
unit would be best to use in measuring its length? 

A, An inch 

A foot Cr"'^^^^ 
C A yard ^ 
A metre 

M6 



In Example C a student might confuse the word 
"volume" as it is used in this item with the use of 
the word to denote loudness, a^ in the volume of a 
radio, Howeven if this item appears in a test for a 
science course in which the meaning of the word 
volume has been taught, then this item would be 
appropriate. 

Example C 

Which unit is used to measure liquid volume? 

A, Litre 
6, Kilogram 

C, Metre 

D, Centigrade 

Use the simplest language possible. When vocab- 
ulary is not being assessed, phrase directions, items, 
and response options in the simplest language 
possible. For example^ the item in Example D can 
be simpUfied by substituting the word "best" for 
"most appropriately." 

Example D 

The distance from New York City to Los Angeles is 
mosi appropriately measured in: 

A* Kilometres 
6, Metres 

C, Centimeires 

D, Millimetres 

Example E contains three more samples of the 
type of revisions that might make items easier to 
read and interpret. 

Example E 



As written 


Suggested revision 


How much money Itave 
you written checks for this 
month? 

$4,50/hr. 

Which of the following coun- 
tries is not located east of 
Uie Nile? 


During the past month what 
is the total dollar amount of 
checks you have written? 

$4,50 per Uour 

Which of the following 
countries is located west of 
the Nile? 



Avoid use of idiomatic expressions. Many idio- 
matic expressions that we take for granted are 
difficult or impossible to understand^ especially for 
someone who is not a native speaker of English, 
In Example the idiomatic expression "meeting 
her expenses" may not have meaning for some 
students, A good substitute would be "paying lier 
bills," 

Example F 

If Mariha Is paid $500 and pays $180 for rent, $20 
for utilities, and $100 for food, how much money does 
she have left after meeting her expenses? 
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In Example G "Due" east or south may not be 
clear to some students. The word **due" could be 
eliminated. 

Example G 

To drive from Falls City to Hope, you would travel: 

A. Due east 

B. Due south 

C North, then west 
D. East, then north 

The use of the word "spotted" in Example H is 
idiomatic and may be replaced with **saw/' 

Example H 

Chris Jones has finished the junior year at Truman 
High School and has been looking for a summer job. 
Chris spotted the following advertisement in the daily 
paper and has decided to apply for the job. . . . 

Avoid offensive terms. Obviously, all racial or 
ethnic slurs are offensive and should be avoided 
along with all other offensive terms. Items should 
also reflect current usage regarding sex bias (for 
example, avoid the use of the word "girl" for an 
adult female and the use of **chairman" rather than 
"chairperson" or "chair^'). 

Avoid using words that have different meanings 
for different groups. Using words that have differ- 
ent meanings or connotations for different racial or 
linguistic groups could distort tesi results. For 
example, words such as "blood," "hog," and 
"short" have different meanings for some blacks 
than they have for most whites. Specifically, 
"blood" may be used to refer to another black 
person> and "hog" and "short" may be used to 
refer to a car. 

Use item content that reflects the composition 
of the community served by the district. Some 
educators recommend that a test include items 
reflective of each of the various cultural groups; 
others contend that a test should be designed to be 
as culturally neutral possible. Regardless of the 
approach a district takes, the district should make 
every effort to design the instructional program to 
reflect the pluralistic nature of society. 

Avoid items which reflect stereotypes. Examples 
I and J ^re samples of items that reflect roles 
stereo typically associated with certain ethnic 
groups or nationalities. Such categorizing can be 
easily avoided by changing the names or the 
occupations. Examples K and L reflect typical 
sex^role stereotypes and can be remedied by 
merely changing the sex of the names. 



Example 1 

Jose and Roberto drive togeJier 60 miles one way 
each day to their jobs at the car wash. If they drive 30 
miles per hour, how long will it take them to get to 
work? 

Example J 

Ralph Cheng's father owns a laundry that makes over 
$5,000 per month. If there are 21 working days in a 
month, what is the average income per working day? 

Example K 

Sally bought a new sewing machine costing $270. She 
paid $50 ^ a down payment and was to pay the rest of 
the cost in six equal payments. If no other dtargcs are 
included, how much would she pay each month? 

Example L 

Dick bought a new power saw costing $55. If he had 
$125 to spend, how much money would he have left if 
he also buys a drill costing $45? 

Each item need not reflect the reverse of the 
stereotype, but a balance should be sought 
throughout the test These same stereotypes can 
also be used conversely to create positive images as 
in Example M. 

Example M 

Maria was recently promoted to a position as brandt 
manager at First Rate B^nk. Her new salary is $250 
more a month than she earned in her previous position. 
Her previous salary was $1,400 per month. What js her 
current monthly salary? 

Avoid items that reflect concepts either non- 
existent within one culture or unique to a culture. 
For example, members of the Navajo culture do 
not use words that refer to affect (such as "I 
feel . . ."). Another example is that in Texas a 
scorpion may be called a stingltzard. 

Examine the content of items which have been 
identified as being biased in previous empirical 
studies. In a recent study it was found that many 
black children consistently had difficulty with 
items containing words such as "fewer/' **closer," 
and **larger."^ Again, this finding does not mean 
that a district should not test for knowledge of 
these concepts nor use the terms in a test item. 
Instead, if a district decides to test students on 
these concepts, it should be certain that the 
concepts are taught in the classroom. A district 

^J. Scheuneman, "A Procedure for Evaluating item Bias in the 
Absence of an Outside Criterion.''* A paper presented at the annual 
meeting of the American EducationaJ Research Association* San 
Francisco, April, i976. 
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should also try to find substitutes for the terms 
when they appear in test items designed to measure 
knowledge of something other than the concepts 
associated with the terms. The words are, however* 
so common in everyday life that it may be more 
sensible to try to ensure that all students firmly 
understand such words. In such cases the informa- 
tion generated from efforts; to identify biased items, 
particularly through the kind of analysis described 
below, can be useful in guiding instruction* 

In another study it was found that test items 
involving television shows featuring blacks were 
biased in favor of blacks.^ Judging from these 
results, a district should carefully screen items 
relating to books, television, or films to ensure that 
they do not favor any particular group. 

Finally, it may be useful for the test review 
committee to review rules for writing test items 
prior to the item review process. (See ^^References'* 
for a list of measurement texts that contain 
sections on item-writing rules.} 

It Js impossible in this paper to identify all of 
the cultural variations that may cause bias in test 
items. Because an awareness of such variations is 
essential to the creation of an unbiased test, the 
selection of persons to conduct a test bias review is 
a critical step in the test review process. 

Phase 11: Identifying Biased Items Using Field Test Results 

Several statistical approaches have been devel- 
oped for using field test results to examine the 
interaction between test items and groups. How- 
ever, when the approaches were compared with 
each other, the results revealed that except for a 
very few cases, each approach identified different 
items on the same test '^as being biased.^ In 
addition, most of these approaches are fairly 
complex and time-consuming, often requiring 
access to a computer if either the number of test 
items or students is very large. Because of the 
difficulty involved in such approaches, a simplified 
approach is presented here, and the more complex 
approaches have been referenced in the bibliog- 
raphy for interested districts. 

It is important* to reiterate that the primary 
concern here is not to determine whether there is a 
difference between the overall scores of various 
groups. The purpose of this approach is to identify 
test items that are more difficult for one group 
than would be expected based on the group's 

*G.H. tronson. "A Qsmparative Analysis of Several Methods of 
Assessing item Bias." A paper presented at the annua] meeting of the 
American Educational Research Association, Tononto, March, i978. 

^This may be due to the variations in definitions and assump- 
tions underlying the appfoache& 
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overall performance and to provide information for 
revising the measure accordingly. The steps in the 
procedure are as follows. ^ 

1. Administer each of the subtests that com- 
prise the proficiency test. When conducting the 
Held test, provide both teachers and students with 
forms on which to indicate their perceptions of 
any test items and directions that are unclear. 
(Exhibit B contains sample forms for this purpose.) 
The test administrator should tell students that the 
test is a field test and that the results will be used 
only to refine the test or to revise the instructional 
program, not to give grades or to award or deny 
diplomas. 

2. Sort subtest results by the ethnic, sex, or 
socioeconomic status groups the district may be 
interested in looking at. 

3. For each subtest within a content area* 
calculate the percent correct value of each item for 
each group. A percent correct value is determined 
by dividing the number of correct responses for an 
item by the total number of students who re- 
sponded to the item: 

number of correct responses to item 

^ number of students who responded to the item 

Percent correct values range from 0.1 to 1.0. Lower 
numbers indicate that the item Is more difficult; higher 
numbers indicate easier items. 

4. For each subtest, list the percent correct 
value for each item by group as indicated in Table 
1. 

5. Draw a vertical axis foreach group (see Table 
2) and mark it off by intervals that coincide with 
the percent correct value scores ;(in , this case 0.1 
intervals). Place an ^^x** next to the appropriate 
percent correct value on this vertical axis for each 
item. For example, in Table 1 the percent correct 



TABLE I 

Percent Correct Values for Eadi Item 
in Math Subtest U by Subgroup 



[tern No. 


Subgroup 1 


Subgroup II 


Subgroup III 


1 


0.5 


0.3 


0.8 


2 


0.4 


0.5 


0.7 


3 


0.6 


0.2 


0,8 


4 


0.4 


0.4 


0.9 


5 


0.5 


0.3 


0.6 


6 


0.4 


0,4 


0.7 


7 


0.6 


0.2 


0.5. 


8 


0.1 


0.1 


0.7 


9 


0.9 


0.6 


1,0 


10 


0.4 


0.3 


1.0 



TABLE 2 

Plots of Percent Correct Values on Matii Subtest I . by Subgroup 



Subgroup I 


Subgroup 11 


Subgroup III 


tVroent comet 


ItCIQ 


Percent correct 


Item 


Percent correct 


Item 


value 


oumbcx 




value 








value 


number 

j-iw -III- WJ. 


1.0 - 








1.0 










1.0 




- XX 


0 10 


0.9 - 




X 


9 


0.9 










0.9 




- X 


4 


0.8 - 








0.8 










0.8 




- X 


1,3 


0.7 - 








0.7 










0.7 




- XXX 


7 A $t 


0.6 - 




XX 


3,7 


0.6 






X 


9 


0.6 




- X 


5 


0.5 - 




XX 


1.5 


0.5 






X 


2 


0.5 




- X 


7 


0.4 - 




xxxx 


2. 4, 6. 10 


0.4 






XX 


4.6 


0.4 








0.3 - 








0.3 






XXX 


1,5.10 


0.3 








0.2 - 








0.2 






XX 


3.7 


0.2 








0.1 - 




X 


8 


0.1 






X 


8 


0.1 








0.0 - 








OJO 










0.0 








Mean = 


4.8 






Mean 




3.3 






Mean 




7.7 




Standard deviation = 


2.04 


Standard deviation = 


= 1.49 


Standard deviation ~ 


1.64 



value for Item 1 for Subgroup I is Oi; therefore, 
place an "x" next to the 0.5 on the vertical axis 
(see Table 2) for the first subgroup and list the 
number of that item in the item numbers column. 
Item 2 in Table 1 for Subgroup I has a percent 
correct value of 04. Place an **x'* next to 04 on 
Table 2 under the heading Subgroup I. Continue 
this process for ail remaining items and groups. 
Again, the scores for the subtests should not be 
combined; separate graphs should be plotted for 
each subtest. 

Phase 111: Linking Test Results to Instruction 

The graphs in Table 2 reveal several interesting 
and potentially useful pieces of information. The 
mean scores of subgroups I and 11 are consistently 
lower than are the scores of Subgroup III. In 
addition, the scores of students in Subgroup I vary 
more than the scores of students in subgroups II 
and Iir The results also indicate that Item 8 is 
more difficult for subgroups I and H (with a 
percent correct value of 0.1 for each group) even 
when compared with the lower overall scores of 
those subgroups. It also appears that students in 
Subgroup III had no difficulty with the item. Item 
8 should, therefore, be examined to determine 



what makes it more difficult for subgroups I and 
II. In reviewing such items* be certain to review all 
response alternatives (the possible answers), identi- 
fying the alternative most frequently chosen by 
each group, and examine the item stem (the part of 
the test item that provides the question or state- 
ment to which examinees are to respond) and 
directions for clarity. 

It may be useful to ask several students who 
missed the item to explain why they responded as 
they did. On the basis of their responses, a district 
may wish to discard the item in favor of an 
improved item. 

An analysis that can be particularly useful in 
planning an instructional strategy involves compar- 
ing subtest mean scores (average scores) by group. 
For example^ it is obvious from the data in Table 3 
that students in all groups performed better in the 
addition of whole numbers than in the calculation 
of interest rates. Apparently subgroups I and H 
may need more instruction in all areas of computa- 
tion with emphasis on interest rates. This type of 
information along with individual student scores 
provides a blueprint for planning instructional 
strategies to help students having difficulty in 
acquiring basic skills. 



TABLES 

Average Percent Correct (Average Scores) on Math Subtests, by Subgroup 



Subgroup No. 


Subtest 1 
Addition of 
whole numbers 


Subtest 2 
Division of 
percent 


Subtest 3 
Subtraction 
of fractions 


Subtest 4 
Measure- 
ment 


Subtest 5 
Calculation of 
interest rates 


Subgroup I 


60 


40 


30 


40 


20 


Subgroup 11 


50 


40 


40 


50 


10 


Subgroup 111 


90 


SO 


70 


SO 


60 



10^ 



Suininafy 

The definitions of bias fairness as they relate 
to proficiency assessment and the three-phase 
approach described in this paper should help 
districts identify and avoid bias in their proflciency 
tests. The first phase is an item review by persons 
representative of the various cultures in the com- 
munity served by the district. This analysis is 
conducted prior to administering the fleld test The 
second phase involves examining field test results 
to determine. what revisions are needed in the test. 
Phase three is the adjusting of the curriculum and 
instruction as called for by the test results. 
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Exhibit A 



Sample Passing Score Policy 



The mtnimum competency testing progmm is required to verify that students meet district standards in 
reading, writing, and mathematic$. Any test used for such purposes has some we)l*known and limiting 
problems: 

I* Tests have reliability and validity errors which may affect the score of any given pupil* 

2* Test experts are cautious about placing absolute faith in a single administration of a tesL The more 
times the test is ^ven to a ^cific person, the more clearly the true scores are revealed* 

3* Some students have problems taking tests* Anxiety levels, time, and motivation problems all cause 
some students to score less well than they are truly able to perform* 

4* The arbitrary setting of a single score to determine v^ether the student has passed or not passed is 
somehow inconsistent with the factors mentioned in 1,2, and 3* 

5* Passing a competency test has been given an impottance never before placed on such a test* A 
student's graduation and receipt of a diploma may be dlzvctly determined by the score on the test* 

6* The requirement that districts prepare special instructional programs, which are certain to be 
expensive and require additional time and personnel, is a significant imposition for a program already 
struggling with many competing priorities* 

7* It is very impottant that the testing program be maximally efficient and accurate* It would be a great 
waste to deny diplomas to students who can, in fact, read, unite, and work math well enough to 
succeed in sdiool and their lives. Likewi^, it will be a disservice to grant diplomas to students who 
cannot perform tasks requiring these skills at levels generally acceptable in their community. The 
scoring procedure recommended here includes every possible effort to grant passing scores fairly to 
those who can, in fact, read, write, and compute and to identify those who need more instruction 
before they can achieve the minimum competencies* 

Because of these factors this ^commendation contains a scoring procedure in which high scoring 
students automatically pass and low scoring students are automatically judged not to have passed the test 
yet* Students whose scores fall in the middle range wilt have their test performance leviewed by school staff 
against some criteria and against the experience of the given student's teachers with that student's 
performance of the skills being verified* 

Students who score SO to 100 percent of all points available on the test shall be automatically certified 
to have passed* 

Students who score 60-79 percent of all points on the test will have their responses evaluated by the 
school staff to determine whether or not their ability to read, write, and work math has been established at 
a minimum competency level* The school counselor shall »view each student^s performance, applying the 
following criteria: 

1* The student's total score is accurately computed and totals 60 to 79 percent of all points available on 
the test* 

2* The subsection scores for reading, writing, and mathematics are each at least 60 percent of the 

specific section's points or higher* 
3* The majority of the student's teachers indicate he or she can perform these three skills well enough to 

do the required work in basic courses which require reading, writing, or mathematics skills* 

The school counselor shall certify that all those students whose performance meets the three criteria above 
have passed the test* 

Students who score between 60 and 79 percent of al) points but whose performance does not meet the 
three criteria above shall have their test performance reviewed by a staff committee composed of the 
counselor (or test coordinator), principal, and the student^s teachers of reading, writing, and mathematics* 
This committee may judge: (1) that the student does possess mtnimum competency and so passes the 
lequizvments; (2) that the student has passed one or two of the specific sections of the test and will be 
retested only on the section(s) not yet passed; or (3) that the student has not passed and the whole test 
must be taken again when next ofTer^* 

All students with sco»s on the total test between 0 and 59 percent of the total points wilt be 
automatically judged not to have passed the test yet* 

The school will prepare an individualized program for each student who has not yet passed the test* This 
program will be pzvsented to the pupil and his or her parents in a conference arranged by the principal or 
the test coordinator* 



NOTE: This sample passing score policy was obtained from a school district and is included here to illustrate the 
difOcutties bwotved in reaching consensus on passing scores* 
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Exhibit B 

Sample Directions for Field Test Critique of Proficiency Tests 

by Test Administrators 

This ileld test is bdng conducted for the purpose of ironing out problems with the directions and test 
items themselves. Piease help us by completing the attached test administrator's critique as follows: 
l> Review the test yourself as the students take it and record your criticisms. 

IL Note any questions asked by students whether or not you can answer them. Note the page and 
question numbers in the spaces provided* Note, also, the ethnic group of the student asking the 
question* 

III. After the test has been collected, distribute the atuched student critique form to record students' 
reactions and complaints. Record your impressions of the students* general reaction to the test» 
including their attitudes and cridctsms. 

IV. Note any aspects of the testing in which time miQr have been a factor. 

Thank you for this information. With your help and that of the other teachers* we art in the firal 
phase of creating a set of high school proficiency tests that will be valid* reliable* 9Qd unbiased. 
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Sample Form for Field Test Administrator's Critique 



Teacher School 

Grade level of students (please circle ): 7 8 9 10 11 12 
L Test admiiustrator^s critique: 



II. Questions from students: 

Student^s 

Page Question sex and 

number number ethnic group Question/ criticism 



III^ Students* general reactions and complaints: 



IV, Did students have enough time to finish the test? Was time a factor In any other way? Explain. 



Please return this form with the tests. 
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Exhibit B (continued) 



Sample Form for Student Critique of Proficiency Test 



Yourformnumber. 
Your grade level 



Tests are improved by fleld-testing them* YOU, the test taker, are one of the most valuable sources for test 
improvement. 

Please help us to make this a fairer test by marking an Xin a numbered box in response to each statement on the 
left* At the bottom of this sheet, you have a chance to give more detailed reactions in your own words* 



Statements 

L The test was fair as a 
minimum standard for 
graduation* 

2* The test items were clear 
in the way they were 
worded, please list 
below the number of any 
items that were unclear 
and explain why they were 
unclear*) 

3* The directions given 
were clear and complete. 

4* The test items were 
interesting. 

5* The pictures and diagrams 
were large enough^ 

6* The printing was large 
enough and was spaced 
clearly. 

7* The test was administered 
clearly and carefully* 
(Did you know how much 
time you had left?) 

8* The atmosphere was condu* 
cive to test-taking. 
(Was the room quiet?) 



Strongly 
disagree 
1 

[ ] 
[ ] 



[ ] 
1 ] 
[ ] 
[ ] 

[ 1 
[ ] 



Disagree 
2 

[ 1 
[ ] 



[ 1 
[ ] 
( ] 
[ ] 

[ ] 
I ] 



Neutral 

3 

[ 1 



[ ] 



[ ) 
I ] 
[ ] 
[ ] 

[ 1 
[ I 



Agree 
4 

t ] 
[ 1 



t ] 
t ] 
t 1 
t ] 

{ ] 
t ] 



Strongly 
agree 
5 

t ] 



[ 1 



I ] 
[ ] 
t ] 
[ ) 

I ] 
[ 1 



General Reaction/Complaims. Please take a few minutes to describe your reactions to this test, referring to ^ci^c 
sections or questions on the test if you can. 
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The Resource Caialog for Prt>fici€ncy Assessment was compiled for educators who want 
more information about compctcney-basod education and proficiency assessment. This list 
of documents ts annotated and arranged according to whether the documents contain 
Information about proficiency assessment in general. speciHc subject competencies^ or tests 
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The catalog also includes a seetion of documents that arc not available from SMBRC. 
Baeh entry in that section contains a description of the publieation and full ordering 
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Foreword 



Assembly Bill 3408 (Chapter 856, Statutes of 1976). which became effective on Janu- 
ary 1 , 1977, requires high school districts and unified school districts maintaining a junior or 
senior high school to establish district proficiency standards in reading comprehension, 
writing, and computation and to assess, on a prescribed basis, the performance of students 
in grades seven through twelve. The law requires that after June, 1980, no student who has 
not met the locally adopted standards of proficiency shall receive a high school graduation 
diploma. In 1977 Assembly Bill 65 (Chapter 894, Statutes of 1977), the comprehensive 
school finance legislation, extended the requirements to elementary schools, requiring 
districts to assess the performance of students at least once in grades four through six. 

To help districts meet these requirements, the Legislature required the State Department 
of Education to prepare and distribute an "assessment framework" to all districts. The 
Technical Assistance Guide for Proficiency Assessment and the Sample Assessment 
Exercises Manual, volumes 1 and IN have been developed, addressing the needs of secondary 
school districts, and sent to California school districts to meet that requirement. As a result 
of AB 65, the Technical Assistance Guide has been revised and a new exercises manual has 
been developed to address the needs of school districts maintaining elementary schools. 

Tliis Resource Catalog for Proficiency Assessment, also included in the Technical 
Assistance Guide, was produced as a separate document since not all interested persons will 
have access to the Tec/\n{cal Assistance Guide. 

The Department of Education, the San Mateo Educational Resources Center (SMERC), 
and other groups assembled these resource materials for use by those with responsibility for 
developing proficiency assessment procedures and related instructional programs. For this 
revision of the Catalog, previously appearing entries were revised and checked, many new 
entries were added, and all entries were newly classified and organized. 

Most materials listed in the body of the Cj/j/o^ are available from SMERC, Journal articles 
are available in photocopy format; other documents are available in microfiche format. In a 
few cases materials available on SMERC microfiche are also available from the original 
sponsoring agencies in a ''hard-copy" format* Such cases are noted in the entry. The Catalog 
also includes a section of resources that are not available from SMERC. Tliese are materials 
considered important enough for inclusion despite the fact that the procedures for ordering 
them are not as centralized as for the SMERC documents. Ordering information 
accompanies the entries for each non-SMERC Publication. 
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tion Requirements: Tips and CuidelineV Thmsi for 
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JO-I2.JJ121* 
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petencies required for high school graduation. 
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Some Curricular Issues," Educaiioml Leaderdiip, Vol. 
35 (November, 1977). 86^9LJJ110 

Cook. J. Marvin. '*The D.C Schools' Plan for Systemwide 
Achievement/* Educaiional Leadership. VoL 35 
(November. 1977), I14^17JJI 15 

Cram, David **The Ideal Course," Trainiug. Vol 12 
(December, 1975), 74-76, 78. JJ47 
A discussion of the twelve characteristics of an ideal 
training course, including behavioral objectives, provi* 
sion for student differences, prjctice, feedback, diverse 
materials, and progress information. 

Eisele, James, E.. and Paul M. Halverson. '^Assumptions 
Underlying Competency* Based Education,'* Thrusi for 
Educaiion Leadership. Vol. 5 (November. 1975), 4—6. 
JJ4I 

A setting forth of the assumptions underlying 
competency*based education from the viewpoint of 
proponents and opponents. 
Oilman, David Alan. ^^Minimum Competency Testing: An 
Insurance Policy for Survival Skills," NASSP Bulletin. 
Vol. 61 (March, 1977), 77-84. JJ1I7 

Click. I.David, and others. **CBE: How to Prevent a Second 
Orthodoxy," EduCatioml Technology, Vol. 15 (August, 
1975), 17-20. JJ42 

An argument that a complete transformation of class* 
room procedures and curiiculum developmen t is required 
to prevent the cumculum from becoming rigidified. 

Herschbach^ Dennis R, "Deriving Instructional Content 
Through Task Analysis/^ Journal of Industrial Teacher 
Educaiion. Vol. 13 (Spring, 1976), 63-73. JJ46 
A model for developing competencies within the voca* 
tional arca^ using task analysis as a means of incor* 
porating current learning theory into instruction. 

Hornbeck, David W. "Maiyland*s 'Project Basic'," Educa- 
tional Leadership, Vol. 35 (November. 1977). 98-101. 
JJllI 
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Huff, Maiylyn. ''A Board Member Looks at Requiring 
Competencies for Cmduation," Educaiional Leadersfiip. 
Vol. 35 (November, 1977), 108-13. JJ1I4 

Keefe, James W., and Constance J. Georgiades. 
'Competency* Based Education and the High School 
Diploma,'* NASSP Bulletin. Vol. 62 (April, 1978), 
94-108. JJ118 

A review of the background of competency*based 
education, its merits, and drawbacks with recommenda* 
tions from the National Association of Secondary 
School Principals. 

Lewenstein, Morris R, "CBE: Commitment Is Not 
Enougli." J7iniSi for Education Leadership, Vol. 5 
(November, 1975), 7-9. JJ43 

The use of competency*based education as a basis for 
curriculum planning to emphasize the intellectual pro 
cess and program evaluation. 

McClung, Merle Steven. "Are Competency Testing Pro* 
grams Fair? Legal?" Ffii Delia Kappan. Vol. 59 
(February, 1978), 397-400. JJl 33 
An examination of possibly illegal designs or implemen* 
tation procedures for competency tests, including a 
suggested model program. 

Messick, Rosemary C. '*Competency*Based Education: In* 
service Implications," Thrusi for Education Leadership, 
VoL 5 (November, 1975), 16^18. JJ44 
An article containing the argument that for competency* 
based education to become functional, administrators 
must gain greater expertise in curriculum and instruction 
and assume more leadership in staff development. 

Nance, W. R, "Bus." "How Fares Competency Develop- 
ment in Oregon?" Educational Leadership. Vol. 35 
(November, 1977), 102-5, I07.JJI13 
A description of Oregon's experience with developing 
and implementing new requirements for high school 
graduation, based on minimum competency standards 
defined by school districts. 

Pipho, Chris. "Minimal Competency Testing: A Look at 
State Standards," Educational Leadership, Vol. 34 
(April, J977), 5 16-20. JJl 16 

Schab, Fred. "Who Wants What Minimal Competencies?" 
Phi Delia Kappan, Vol. 59 (January. 1978), 350-52. 
JJl 32 

A survey of teachers, students, administrators, and 
parents in Georgia showing a diversity of opinion 
regarding the levels of readings writing, listening, speak- 
ing, and arithmetic skills that should be required for high 
school graduation. 
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Steiner, Richard L, "The Case for Competercy-Based 
Education," Science Teacher, Vol 42 {Etecember, 
1975), JJ40 

An identification of learning objectives in competency- 
based education* including an example of a long-range 
goal, with competency statements and performance 
indicators. 

Strike, fcnneth A. *'What Is a ^Competent' High School 
Graduate?*' Educational Leadership, Vol 35 (November, 
J977). 93-97, JJn2 

An argument that a key question underlying 
competency-based education is what kinds of knowledge 
and skills are of significant social importance to society 
and that society's fundamental interests are in the 
education of politically and economically competent 
citizens, 

Micfofidie Documents 

Alvir, Howard Saving Educational Dollars Through 
QuaMty Obfectives. ERIC, n.d, EDI 15584 115 pages. 2 
microfiche* 

A description for teachers of quality objectives* ones 
that are marked by clarity* accessibility, accountability, 
and ability to be evaluated by laypersons, 

Anderson* Earl N. Coping with Oregon 's New Competency- 
Based Graduation Requirements: View from a Practi- 
tioner ERIC, 1975. ED105594 13 pages, 1 microfiche. 
Background information about the new Oregon gradua- 
tion requirements* to identify several major problems 
faced by Oregon school districts in putting into opera- 
tion the new graduation requirements* and to describe 
the role of the consortium approach in providing 
technical assistance to local school districts, 

Basic Proficiency Monitoring System. Half Moon Bay* 
Calif.: CabriUo Unified School District, 1977*10005828 
84 pages, 2 microfiche. 

A document on the basic proficiency monitoring ^stem, 
including information on district philosophyi back* 
gtound and discussion material on proficiency assess* 
menti teacher instructions, and student proficiency 
levels and tests, 

Basic Skilis Assessment Around the Nation, An Educational 
Testing Service information report, Princeton, NJ.; 
Educational Testing Service, 1977, EDI 52796 25 pages. 
I microfiche. Also available from Educational Testing 
Service, Basic Skills Assessment, Rosedale Road, Prince- 
ton, NJ 08541 (no charge). 

A summaiy of minimim standards and basic skills 
assessment activities at the federal, state, and school 
district level* as of September, 1977. 

Beaverton Schoors Student Competencies fi>r Graduation, 
Bcaverton, Oreg.: Beaverton School, 1975. 1D005 389 30 
pages, 1 microfiche. 

Competency statenients in three major categories and a 
varied of subcategories: (I) personal development* 
including communication skills^ computation skills. 




scientific- technical knowledge, healih/mind/body; (2) 
social responsibility, encompassing citizenship, environ- 
mental awareness, and consumerism: and (3) career 
development, dealing with career decisions, career atti- 
tudes, working relationships, and career skills. 

Chase* Cheryl, Q)mpetency-Based Education: An Infr>rma- 
tion Piwkase. Denver, Colo,: State Etepaxtment of 
Educarion, 1977, ED146709 40 pages, 1 microfiche. 
Also available from Colorado Ctepartment of Education* 
Project ACCESS, State Office Building, 201 E. Colfax 
Ave,, Denver, CO 80203(51), 

An information package for teachers^ administrators, 
school boards, and legislators interested in exploring the 
area of competency-based education, including back- 
ground information and an annotated bibliography of 
ERIC sources, 

Clark, James P., and Scott Thomson. Competency Tests 
and Graduation Requirements. ERIC, 1976, ED 1261 60 
76 pages, 1 microfiche- 

A review of a variety of specific competency tests that 
measure skill achievement required for high school 
graduation; a background of the competency test move- 
ment; and lists of states and schools using competency 
tests and legislation and state board rulings conceming 
competency tests. 

Competency Based Education in Oregon, Portland, Oreg,: 
Northwest Regional Educational Laboratory, 1976. 
ED147949 97 pages, 1 microfiche. 
An examination of the competency-based education 
movement in Oregon, which resulted in the adoption of 
the Minimum State Requirements for Graduation in 
1972 and the subsequent adoption of competency-based 
Minimum Standards for Oregon Public Schools in 1974, 

Competency Based Education Sourcebook, Portland, Oreg,; 
Northwest Regional Educational Laboratory, 1977* 
EDI47952 483 pages, 5 microfiche. Also available from 
Dept. K, Office of Marketing and Dissemination, North- 
west Regional Educational Laboratoiy, 710S.W, Second 
Ave., Portland, OR 97204 {$22,50, postage paid), 
A comprehensive guide for curriculum planners, adminis- 
trators, teachers, and others invoWed in the planning and 
implementation of competency-based education. 

Comprehensive Education Plan. School Year 1911*18, 
Washington, D.C: District of Columbia Public Schools, 
1977, ED145590 399 pages. 4 microfiche, 
A comprehensive plan providing for the completion of a 
year-long awareness program on competency-based edu- 
cation, revised instructional goals through a ^stemwide 
needs assessment, student population projections! and 
budgeting practices, 

Conaway, Lariy E. Setting Standards in Competency -Based 
Education: Some Current Practices and Concents. 
SMERC, 1977, 1D005598 26 pages, 1 microfiche, 
A discussion of standard setting from the perspective of 
the practitioners presently faced with implementing 
competency-based programs. 
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Corder. Reginald. New Directions in Assessment and 
Cerdficanon of Adults. SMERC, 1977. ID005533 16 
pages. I microfiche. 

A review of educational trends in the certification of 
adults, includhig efforts to grant credit for basic compe^ 
tencies gained as a result of experience rather than 
formal class work* 

Dobbert. Daniel J, A General Model for Compcteiicy-Bascd 
Curriculum Development ERIC. 1976. ED122386 21 
pages* 1 microfiche* 

A n<^ traditional definition of competency and ^ de* 
tailed description of a comprehensive model for the 
development of competency -based curricula based on 
that defhiitjon* A flow chart of the modefs seven major 
components and a detailed outline of its subprocedures 
are presented^ and alternative strategies for accom* 
plishing each component are discussed* 

Evenson. Patricia 0* Competency-Based Curriculum 
Development for Rural Secondary Schools in Alaska: A 
User's Guide. SMERC. 1977. 1D005595 152 pages. 3 
microfiche* 

A description of the North Slope Borough School 
District*s competency-based curriculum with the recom- 
mendations of other districts that have used the North 
Slope process and materials. 

Fremer, John. Setting and Evaluating Competency Stan* 
dards for Awarding High School Diplomas, SMERC, 
1977* 10005599 23 pages* 1 microfiche. 
A discussion of seven principles for developing and 
administering competency standards and for setting 
standards* 

Fulfilling the Mission: A Program for Excellence, Efficiency 
and Effectiveness, in five volumes* Washington* D*C.: 
District of Columbia Public Schools, 1976. (Vol* 1: A 
Design for Competency Based Curriculum. Pre- 
Kindergarten- Grade Twelve. Vol* 11: A Design for the 
Deltpery of Educational Services. Vol. Ill: ne Organiza- 
tional Schema, Vol IV: Part 1, Planning; Part 11, 
Research and Evaluation, Vol. V: Frospecms,) Vol* I: 
ED133801 132 pages, 2 microfiche; Vol. 11: EDI33S02 
30 pages, 1 microfiche; Vol. Ill: ED133S03 21 pages, 1 
microfiche* Vol. IV: ED133S04 21 pagPs, 1 microfiche; 
Vol, V; ED13380021 pages, 1 microfiche* 
A series of five publications covering the educational 
program of the District of Columbia Public Schools, the 
foundation of which is a competency*based curriculum* 
Volume I contains a description of the tasks students are 
expected to perform and the skills they must possess to 
perform the tasks* Volume W is an outline of the 
district's delivery system for educational services* 
Volume III contains an outline of the plan for imple* 
menting and evaluating the competency based cur* 
riculum* The two parts of Volume IV contain descrip- 
tions of the district s planning division and its research 
and evaluation division* Volume V is a prospectus, 
providing an overview of the goals, priorities, and 
strategjes for the program along with descriptions of the 
other four volumes* 



Cadway. Charles J., and H* A* Wilson* Rigfit to Read: 
Funcrioiial Literacy, Basic Reading Perfomwtce: Sunh 
mary and Highlights of an Assessment of ly-Year-Old 
Smdeuts in 1974-75. SMERC. 1976* ID00559 2 62 
pages, 2 microfiche* 

A description of lite exercises used in and the data 
derived from the Mini Assessment of Functional Liter- 
acy (MAE^) test, which was administered in 1974 and 
1975 to determine the extent of functional literacy of 
American seventeen-year-old students* 

Class, Gene V* Standards mid Oiteria SMERC. n.d* 
ID005555 55 pages. 2 microfiche* 
An examination of the ordinary usage of the words 
standards and criteria in measurement literature, includ- 
ing the evolution of performance standards in criterion- 
referenced testing, methods of setting performance 
standards, and comments on the politics involved in the 
issue* 

Graduation Prt}ccss. Saint Paul, Minn.: Saint Paul Open 
School, 1977. lD005379fi pages* 1 microfiche* 
A description of the graduation requirements of the 
Saint Paul Open School, a demonstration school that has 
established competency standards in six general cate* 
gories (career education, community involvement and 
current issues, consumer awareness, cultural awareness, 
information finding, and personal and interpersonal 
skills)* which students meet by proving their ability 
through their own methods or projects* 

Graduation Reqitiremetits Guidelines (Revised edition). 
Salem, Oreg*: Oregon I>partment of Education, 1977. 
1D005593 101 pages* 2 microfiche* 
New guidelines designed to aid districts and communities 
as they develop and improve their graduation require- 
ments* 

Graduation Requirements Handboolc Portland. Oreg*: 
Parkrose School District, 1976, 1D005367 49 pages. 2 
microfiche* 

Information far administrators on credit requirements, 
competency requirements, certification of competencies, 
competency sequence flow charts, methods for verifying 
competencies, and suggestions for recordkeeping and the 
use of alternative educational experiences in relation to 
Oregon's new graduation requirements* 

Graduarioii Requirements: NASSP Special Task Force 
Report. Washington, D.C.: National Association of 
Secondary School Principals* 1975. EDI 1 1071 30 pages. 
1 microfiche* 

A report by the National Association of Secondary 
School Principals on current trends in graduation 
requirements, the meaning of the diploma, verification 
of requirements, alternative diplomas* and articulation 
with postsecondary education* 

Howard, Eugene R* Competency-Based Education: Trap or 
Opportunity. Etenver, Colo.; State Etepartment cif Edu- 
cation, 1977* ED149443 16 pages* 1 microfiche. 
A discussion of tlie opportunities afforded by 
competency 'based education to individualize instruction 
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and tu increase communicutiun alung with a descripliun 
of eight traps thai lie hidden in the CBE movement. 

Huisart, Richard, Outime of Presentation: Assessing Basic 
Skills and tstablishing Criteria for Competency. 
SMERC n,d, ID005600 6 pages, 1 microfiche. 
An outline and bibliography on identifying basic skills 
objectives and evaluating basic skills, 

Koffler, Stephen L, An Analysis of l*^KA Title / Data in 
New Jersey. Occasional Papers in Edocation. Trenton. 
NJ.; State Department of Education. 1976. ED1462I7 
88 pages, 1 microfiche. 

A stody of the distribution and effect of ESEA Title I 
funds in New Jersey, in conjunction with information 
concerning reading and mathematics achievements pro- 
gram adopiion, and demography to determine correla- 
tions with ESEA Title I programs. 

Koffler. Stephen L, New Jersey Statewide Minimum Stan- 
dards: Results fro^i the Phtgram's First Year. Occasional 
Papers in Education. Trenion. NJ.: State Etepartment of 
Education, 1977. ED146216 52 pages. I microfiche. 
The results of the proficiency test administered by the 
New Jersey Educational Assessment Program to all 
fourth, seventh, and tenth grade students in the state as 
a part of the 1976 law that established uniform 
statewide minimum standards in basic communication 
and computation skills. 

Lasser. Barbara R., and Allan L. Olson. Strategies for 
Implementation of Competency Based Hducation Pro- 
grams. Washington, National Institute of Hduca- 
tion. 1977, FD147950 146 pages. 2 microfiche. 
An identification and discussion of considerations in 
installing and maintaining c*ompetency*based education 
programs. 

Making Effective Use of the School Counselor KJZ 
SMERC. 1977. ID005601 16pag^s. I microfidic. 
An examination of ihe services rendered by counsctois 
at specific educational levels in the light of a6 3408. 

Mathis. William J. New Jersey Miniimm Basic Skills 
Program Paper presented at the annual meeting of the 
National Council on Measurement in Hducation. April, 
1977 Trenton, NJ.: State Department of Education, 
1977, ED 1 391 18 17 pages. I microfiche. 
A description of the newly instituted (1977*78 was llie 
first year of fuU implementation) minimum standards 
program in New Jersey, 

Miller, Lorin L. The New State Graduation Requirements: 
An Overview and Discussion. Eugene. Oreg.: Oregon 
School Study Council. 1977. EDI.15075 39 pages. 1 
microfiche. Also available from Oregon School Study 
Council. 124 College of Education, University of 
Oregon. Eugene. OR 97403 ($1.50), 
An examination of the Oregon competency^based high 
school graduation requirements that became effective in 
the fall of I97f>. some of the pros and cons of the 
requirements, tht' early experience with ihe require* 



ments, and speculation about the rcquircments' eventual 
impact in addition to a model plan to aid school 
districts in complying with the new requirements. 

Minuml CompetetKy Testing: Jssues and Procedures, An 
Anmtated Bibliography. Compiled by Barbara M. Wilde* 
muth. ERIC, 1977. EDlSOISS 20 pages. I microfiche. 
Also available from ERIC Clearinghouse on Tests. 
Measurement, and Evaluation. Educational Testing Ser* 
vic^, Princeton. NJ 08541 ($2.50>. 
A selected bibliography-based on eompoier searches of 
the Educational Resources Information Center, National 
Technical Information Service. P^chologjcal Abstracts, 
Exceptional Child Education Abstracts, and Dissertation 
Abstracts- compiled to aid those involved in developing 
programs to meet legislative requirements to institute 
c^jmpeiency testing. 

ThQ National Conference on Minimum Competencies: 
Trends and Issues, Proceedings of the conference held at 
the City University of New York on March 4, 1977. 
Edited by Richard M. Bossone and Lynn Quitman 
Troyka. New York: Ci^ University of New York. 1977. 
ED141404 1 19 pages. 2 microfiche. Also available from 
CUNY Research Foundation. Center for Advanced 
Study in Education, Graduate School of City University 
of New York, .13 Forty-second St,. New York. NY 
10036 (S3). 

The six papers presented at the National Conference on 
Minimum Competencies: Trends and Issues, held on 
March 4, 1977^ and sponsored by the Center for 
Advanced Study in Education of the City University of 
New York and the Board of Education of the City of 
New York. 

Neill, Shirley Boes. Tfie Competency Movement: Problems 
and Solutions, AASA Critical Issues Report. Washington, 
D.C<: American Association of School Administrators. 
1978. ED150677 89 pages. 1 microfiche. Alst> available 
from AASA, ISOl N. Moore St.. Arlington, VA 2220^J 
(Stock Na 021005 1 0: S8.95). 

An overview of the competency* based education move* 
ment, including school administrators' conccms and 
attitudes, the experience of several school districts and 
states with minimum competency requirements, and 
practical guidelines for implementing minimum com- 
petency requirements. 

Oliver, Cordon, School Craduation Rettwrements in 
Oregon: A Discussfon of the f*yents Sttrrounding tfie 
J972 Change in Requirements. ERIC. 1974. ED098663 
99pagps. 1 microfiche, 

A description of the Oregon school "survival leveP' 
graduation requirements, the trends and events that led 
to their development, and the Implemenlalion program 
that followed their adoption. 

Oregon Graduation Retirements: Gvidelittes for Planned 
Course Statements. Saletn, Oreg.: Oregon State Depart^ 
mcnt of E^ducation, 1974. EDI09749 52 pages, t 
microfiche. 
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Guidelines and sample materials developed in response 
to requests from teacheis, curricutum planneis, and 
administrators for clarification and modification of 
Oregon graduation requirements. 

Oregttn Graduation Requircmcnxs: Models md Guidelines 
forPenona! Development Education, Section ti Salem. 
Oreg.: Oregon State Etepartment of Education, 1973. 
ED085865 27 pages. 1 microfiche. 
Models for districts for selecting and describing those 
competencies essential to ensure all students' survival as 
a citizen. 

Parker, Charles ^Junior High Student Responsibilities for 
Baste Skills.'' P^per presented at the annual meeting of 
the National Council of Teacheis of English. New York, 
New York, November 24-26, 1977. ERIC, 1978. 
ED151786 1 1 p^s. ] microfiche. 
A paper containing the argument that students should be 
trained to recognize acceptable and unacceptable perfor- 
marK'es in basic skill areas and should assume responsi- 
bility for attaining profkiency in these areas, including 
checking their own assignments, discovering their enois, 
and discussing their error patterns with teacheis. 

Farkrose Graduation Requirements: Student itnd P^ent 
HandboofL Ponland, Oreg.: Parkrose School District, 
n.d.lD005371 19 pages. 1 microfiche. . 
A handbook to help students and parents understand 
Oregon's graduation requirements, including credit 
requirements, competency requirements, certification of 
competencies, timelines and alternative educational 
experiences. 

Place, Roger A< The Performance-Based Currimbim, ERIC, 
1973. ED0771 18 18 pages, 1 microfiche, 
A definition of the performance-based curriculum, 
including some instructional advantages of and obstacles 
to its inception and a brief case study. 

Proceedings of a Conference on ^^hlducationat Reform: The 
Rule of Campetency^Based ltducatiort " Edited by 
Walter Hathaway and Sandra Scolleld. Portland, Oreg.: 
Northwest Regional Educational Laboratory, 1976. 
ED135061 177 pages. 2 microfiche. 
The proceedings of a four-day conference of education 
policy makeis, practitioners, and researchers from more 
than 35 states on the subject of implementing 
competency- based education in public schools, 

Shepard, Loretta A. Setting Standards and Living with 
Them. SmERC, 1976, ID005535 16 pages, 1 microfiche. 
A consideration of the requirements and pitfalls of 
sij*ndard setting and five recommendations for setting 
standards. 

A SxQtement of fSducafional Philosophy^ Gosds^ and Course 
Offerings for xhe Lower Yukim Regional Hducaxion 
Attendance Area. Juneau, Alaska: State Etepartment of 
Education, 1977, lD0Ck5354 395 pages. 7 microfiche. 
A statement of educational philosophy, twenty goals of 
education, a basic description of the instructional 
progranif and planned course statements for each offer- 
ing from grades seven through twelve. 



Stiles, Richard L- Providing for Competency Attainment 
SMERC, 1978. IDO05966 4 pages. 1 microfiche. 
A discussion of the processes involved in deiining, 
developing^ implementing, and evaluating a program 
designed to teadi the baste skills. 

Thieleke, Gene A. Graduation Requirements: WhatArethe 
Trends? Bioomjteld HiUs Public Schools Graduation 
Requirements, l976~Present ERIC, 1976. ED123731 13 
pag^s. I microfiche. 

The graduation requirements of the Bloomfield Hills 
public schools, including the credits that must be earned 
in grades ten through twelve and the minimum compe- 
tencies that must be achieved in each of 14 areas: for 
example, measurement skills, speaking skills, communi- 
cation skills, employment and career skills, and physical 
fitness* 

Thompson, Sydney. Competency^Based Education: Theory 
andPractice. ACSA School Management Digest, Series 1, 
No. 9, ERIC/CEM Research Analysis Series, No, 36, 
Sacramento, Calif,: Association of California School 
Administrators; Eugene, Oreg.: University of Oregon, 
ERIC Clearinghouse on Educational Management, 1977. 
ED149413 52 pages. 1 microfiche. Also available from 
the Association of Cahfomia School Administrators, 
Box 39186, Rincon Annex. San Francisco, CA 94139 
(SI. 75 ACSA members; $2.75 nonmembers). 
An outline of competency-based education in theory (its 
definition, implications, benefits, and problems) and in 
practice (a description of three CBE programs currently 
in operation-California's Basic Skills Program, Oregon's 
Life-Role Program, and the Fairfield^uisun School 
District Career Major Program), with some conclusions 
about creating a successful CBE progrdm, 

Wilson, Robert M., and Marcia M. ^iAmt%.Survivd Learning 
Materials, ERIC, 1974. ED10I3O4 52 pages. 1 micro- 
fiche. 

A booklet designed to provide ideas for teacheis to use 
in developing packets of learning materials, including 
sections on following directions, locating references, 
interpreting forms, and obtaining personal information. 



Information on Califomiii Programs 

Mictoflche Documenis 

Course Outlines: tisinore Junit>r High School Lake Elsi- 
nore, Cahf.: Elsinore Union Hijji School District, 1978. 
ID005933 84 pages. 2 microfiche. 
Outlines for all courses offered at Elsinore Junior High 
School, including prerequisites, course tcngth, overview, 
concepts to be covered, genera) student competency 
goals and testing procedures, and instructional materials. 

DcvelK^ing Proficiency Standards for Graduaihn from 
Higfi SthooL Clendorj, Calif,: Cicndora UniHed School 
District. 1977.1D005541 190 pages. 4 microfiche. 
Tentative prt>cedures and guidelines as well as extensive 
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background data to assist personnel who will be develop* 
ing proficiency standards. 

Examples ofMimmum Academic Standards for GraduatiorL 
Sacramento. Cahf*: Catifomja Department of Education, 

lD005.itS051 pages. 2 microfiche. 
Examples of basic academic standards for graduation; a 
brief management analysts for Hart Bill programs; a 
paper by James Popham on the rnerits of criterion- 
referenced measuiemetit strategies: a review of the 
California High School Proficiency Examination; a set of 
sample competency statements related to intellectual 
skills: and a listing of commercially available cnterion* 
referenced tests and item banks. 

Graduation Requirement Development Program Folsom* 
Calif.: FolsonvCordova Unified School District, 1975. 
1D005547 49 pages. 2 microfiche. 
Information on (1) a list of old and new requirements 
under the California Education Code along with a 
summary of district progress to 1975; (2) a similar 
progress report for January^ 1976; (3) a committee 
report on methods for wnting individual educational 
plans; (4)'ia summary of student imput on required 
courses; and (5) proficiency standards for graduation. 

Graduation Requirements for Foisom-Cbrdova Unified 
School District Folsom, Calif.: Folsom^Cordova Unified 
School District, 1976, 1D00561637 pages, 1 microfiche. 
An outline of the graduation requirements for the 
FolsonvCordova Unified School District, including 
graduation policies and unit as well as specific subject 
area requirements. 

Hart Bill Sourcebook, Los Angeles, Calif: Office of the Los 
Angeles County Superintendent of Schools, n,d. 
1D005606 240 pagps. 5 iracrofiche. 
Sections of the publication A Recommended Prvcess 
and Rationtde for imp^mentation of AB 3408 
as lD00553d) and material developed or compiled by 
the Office of the Los Angeles County Superintendent of 
Schools, providing both administration-oriented and 
progranvoriented approaches to the implementation of 
AB 3408. 

Mmagement Ftans for Development of Readings Whtifig, 
and Math Proficiencies, Azusa, Calif: Azusj Unified 
School District, 1976. 1DOQ5542 10 pages, I microfiche. 
Objectives, activities, and timelines for staff involvement 
in the development of standards and practices for a 
proficiency program in reading, writing, and mathema* 
tics and for the development of graduation requirements 
t or secondary schools, 

McKinley, Donald R. "^Educational Malpractice: The Case of 
Peter Doe et oL ** Paper presented at the annual meeting 
of the National Association of Secondary School Princi- 
pals, Anaheim, California, February 14, 1978, ERIC, 
I978,ED151952 24 pages. I microfiche. 
A discussion of the suit of Peter Dt^e v. San franusco 
Unified Si-hfoi District^ in which a student who received 
a high school diploma was unable to read above a 



fifth*grade level or to function adequately in society- 
including a description of California's Hart Bill (A6 
340S) as amended by AB 65 of 1977 and a model 
competency-based program developed by Merle S. 
McCung. 

A Model for Establishing Stmdairis: Cbfnposition and 
Mathematics, Sacramento, Calif: Association of Cali- 
fornia School Administrators. 1972. 1D003669 153 
pages. 3 microfiche. 

A manual to assist school distnct personnel in establish- 
ing standards of expected student progress and provide 
teachers with examples of instmcttonal objectives in 
composition and mathematics. 

The Newport-Mesa Unified School District Four<:ounty 
Conference on Competency-Based Educathnd Systems, 
Newport Beach, Calif: Newport-Mesa Unified School 
District, 1977. 1DO05356 244 pages. 5 microfiche. 
The handbook used in the Newport-Mesa Unified School 
Distnct at conferences on developing competency-based 
educational systems, including background materials, 
flowcharts, policy statements, competency statements, 
and specific forms used in the management of the 
program. 

Popham, W. James. Observations on the Hart Law, SMERC, 
1976. 1D005388 8 pages. 1 microfiche. 
An analysis of the key features of AB 340S for 
California educators who are charged with its implemen- 
tation. 

Proposed Grmiuation Requirements Santa Rosa, Calif: 
Santa Rosa Elementary and High School districts, 1976. 
1D005386 53 pages. 2 microfiche. 
A review of the graduation requirements of the Santa 
Rosa City Elementary and Santa Rosa City High School 
districts, including survival competency statements and 
performance indicators in the areas of reading, mathe- 
matics, writing, listening, speaking, and health main- 
tenance; required courses; number of credits needed to 
graduate; variable credit; credit by examination; credit 
for travel; credit for community service; and credit for 
independent study. 

Proposed Graduation Requirements: San Mateo Union High 
School District. San Mateo, Calif: San Mateo Union 
High School District* 1975. 1D004994 25 pages. 1 
microfiche, 

A report relating the graduation requirements in the 
areas of basic skills, experiences, and unit requirements 
along with the goals and objectives for the San Mateo 
Union High School District. 

Questions and Answers on the Hart Act. Sacramento, 
Calif: Association of California School Administrators, 
1976. 1D005382 12 pages. I microfiche. 
The transcript of an interview with California Assembly- 
man Gary Hart, author of AB 3408, and Donald R. 
McKinley, Chief Deputy to the Stiite Superintendent of 
Public Instruction, in which they discuss legislative 
intent, the State Department of Education's role>effects 
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on school climate, provisions for learning disabled or 
dtsadvant^d students, and the relation of the Hart Act 
to the StuU Bill and SB 9a 

A Recommended Process and Ranomie for ImpiemenTa- 
rion of AB 3408 in Secondary Sckook Fresno, Calif,; 
Office of the Fresno County Superintendent of Schools, 
n.d, IDO05538 48 pages. 2 mjcrofiche. 
A description of a process that districts may use to 
implement high school graduation requirements and 
standards of proficiency in basic skills, including the text 
of AB S408 and a bibliography. 

Report and Recommendations of ike Educational Sian- 
dmis Cdmminee. San Francisco, Caht: San Francisco 
lAiified School District, 1976. 1DOO5540 52 pa^s. 2 
microfiche. 

Suggestions for minimum promotion standards from 
grades three, six, and nine in readirrg, writing, spelling, 
and mathematics; partial graduation requirements in the 
area of survival skills; minimum standards for mathe^ 
matics and the social sciences; and off*site credit and 
science. 

Santa Barbara High S^ool Di&trict Competency Assess- 
ment Committee: Interim Report to the Board of 
Education, Santa Barbara^ Calif.: Santa Barbara High 
School District, 1977. 1D005532 21 pages. 1 microfiche. 
An outline of ihe philosophy, activities, and projections 
of the committee appointed by the Santa Barbara Board 
of Education to create new policies on high school 
graduation requirements in line with the Hart Bill (AB 
3408). 

School Board Folicy on Graduation Requirements and 
Common Cdre Fefformance Indicators. Fairfield, Calif.: 
Fairfield*Suisun Lbiified School District, 1977. 
1D005551 44 pages. 1 microfiche. 
Three pamphlets: an outline of gi^duation and promo- 
tion requirements for secondary schools; an explanation 
of the malors, the program cores, and the common core 
objectives; and a listing of performance indicators for 
common core objectives. 

School-Community Fianning for Competency Require- 
ments: First Steps To'ward Implementing AB 3408, 
Hayward, Calif.: Office of the Alameda County Superin- 
tendent of Schools, 1977. [D005597 37 pages. 1 
microfiche. 

A description of the first of the four components 
devised by the Office of the Alameda County Supenn* 
tendent of Schools to meet the requirements of AB 
3408: the identification of competencies by methods 
which encourage the involvement of all semgents of the 
school and community. 

Technical Assistance Guide for Proficiency Assessment 
Sacramento, Calif.: Califomia State Department of 
Education, 1977. [D005596 120 pages. 3 microfiche. 
Basic information on the provisions* analysis, and l^gal 
opinions conceming AB 3408 as amended by AB 65; an 
analysis of the intent of the law; step-by-step guidelines 



to implementing the law; and a resource catalog contain* 
ing a variety of source materials useful in planning, 
assessment, and curriculum design. 



Vocational and Career Education Information 
Journal Artktes 

Brown, Keiuieth W. '^Bookkeeping and Accounting: 
Competency-Based System for Accounting Instruction," 
Business Education Foru^ VoL 31 (April, 1977), 
17-18, 20.JJ128 

An outline of a proposed instructional ^stem to help 
the accounting instructor meet the needs of a complex 
business society. 

Bruce, Herbert, Jr., and Bruce Carpenter. "Competency- 
Based Curriculum, Kentucl^ Model,'' American Voca- 
tional Journal Vol. 52 {January, 1977), 58, 60-61. 
JJ123 

A description of the development and implementation 
of modules that will give teachers almost complete 
flexibility in individualized instruction in the area of 
competency -based vocational education. 

Carpenter, C. Bruce, and Maynard J. Iverson. "Tractor 
Mechanics— An Individualized Competency-Based Voca* 
tional Agriculture Program,'* Agricultural Education, 
Vol 49 {March. 1977), 202-3. JJ124 
A description of the Kentucky model competency-based 
vocational education program for tractor mechanics and 
its implementation. 

Hall, Katherine B. ''A New Approach: Competency -Based 
Education,*' Forecast for Home Economics, Vol. 22 
(September. 1976), 127, 161, 176, 178. JJ125 
A discussion of the strengths and weaknesses of 
competency -based education, particularly in the area of 
home economics. 

Mtcroftdie Documents 

Collier, Kenneth, and Duane Etepuy, Vocational Auio 
Mechanics: Course of Study, Grades Eleven and 7\^lve. 
Brooklyn, Ohio: Brooklyn Public Schools, 1976. 
ED145240 166 pages, 2 microfiche. 
A course of study for an automotive mechanics program 
presented as an example of an application of the 
instructional systems design (ISD) process. 

Cdmpeiency Based Curriculum Guide: Career Education. In 
four volumes. Fountain Valley, Calif.: Fountain Valley 
Eiementaiy School District; and Huntington Beach, 
Calif.: Huntington Beach Lbiion High School District, 
1976. (The four volumes are subtitled as follows: Grades 
K-3: Grades 4-6; Grades 7-8: and Grades 9-12.) Grades 
K'3: ED145104 269 pages, 3 microfiche; Grmies 4-6: 
EDI 45 1 07 335 pages, 4 microfiche; Gn^es 7-8: 
EDM5106 370 pages, 4 microfiche; Grades 9-12: 
EDU5105 408 pages, 4 microfiche. 
Curriculum activities guides based on an articulated 
kindergarten through grade twelve career education 
competency curriculum model. 
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Dual Role -Consumer attd Homcmakhig: For the Occttpa- 
lion of Honwmaker. Vocational home economics cur- 
riculum guide for Ohio. Columbus. Oliio: Slate Etepart- 
ment of Education, 1974. EDI50286 741 pages. 7 
microflclic. 

A kindergarten through grade twelve curriculum guide 
devoted to preparing students for dual occupations in 
the consumer and homcmaking areas. 

Kempton, Robert Teaching Guide for BuUding Main- 
ienancc Occupationt Amherst, Mass.: National Evalua- 
tion Systems, Inc., 1976, ED!29985 138 pag&s. 2 
mjcrofiche. 

A teaching guide for building maintenance, one of a 
series of five performance- and employer-based secon- 
dary level vocational education guides, 

Kempton, Robert F. Teaching Guide for Business Machine 
Repair Occupations Amirerst, Mass.: National Evalua- 
tion Systems, Inc.. 1976, ED129984 137 pages, 2 
mjcrofiche, 

A teaching guide for business niachine repair occupa- 
tions, one of a scries of five performance- and employer- 
based secondary level vocational education guides. 

Kempton. Robert F. Teaching Guide for Fire Cadei 
Occupations, Amherst, Mass.: National Evaluation 
Systems, [nc„ 1976, ED129987 149 pages, 2 microfiche, 
A teaching guide for fire cadet occupations, one of five 
performance -based secondary level guides for vocational 
education. 

Kempton, Robert F. Teaching Guide for Sctcial Service 
Occupaiions, Amherst, Mass,; National Evaluation 
Systems, Inc.. 1976. ED 1 29986 130 pages. 2 microfiche. 
A leaching guide for social service occupations, one of a 
series of five perform^mce- and employer-based secon- 
dary level guides for vocational education. 

Kempton, Robert F, Teaching Guide for Siill Photographic 
Tecimician Aide Occupations Amiierst, Mass.: National 
Evaluation Systems, [nc. 1976. ED129988 135 pages. 2 
microfiche. 

A teaching guide for still photographic technician aide, 
one of a scries of five performance- based secondary level 
guides for vocational education, 

McKnight, Molly C. Sample Course of Study for Distribu- 
tive Education: Warehou^ng. Grove City, Ohio: South- 
western City School District, 1976. ED145242 104 
pages. 1 microfiche. 

A description of the content and development of a 
course in warehousing based on , the students' present 
jobs and occupational expectations using the Interstate 
Distributive Education Curriculum Consortium system 
and materials as the foundation. 

Paculba, Leslie A. Forestry Occupations: Career Unit for 
Grades S and 6. San Diego, Calif.: Office of the San 
Diego County Superintendent of Schools and the San 
Diego City Unified School District, 1975. CMOO 1087 37 
pages, I microfiche. 



A curriculum unit guide designed to acquaint pupils with 
the necessity of maintaining forests, the occupations 
related to preserving the forests, and the skills necessary 
to perform forestry -related jobs. 
Post, John 0,, Jr., and others. Occupational Competence 
>lcc^s ProfecL First year report. Boston, Mass.: State 
Department of Education, 1976, EDI33566 190 pages, 
2 mierofiche. 

A report on the first year of tl^ Massachusetts Occupa- 
tional Competence Access Project (OCAP), designed to 
provide secondary school students with marketable skills 
and to increase their abiUry to make decisions about 
careers, including the establishing of a competency-based 
career guidance system, a skill outcome exploratory 
program, and a system of computerized student files. 

Preparation and Use of Insiructional Modules in Driver and 
Traffic Safety Educatioti, Washington, D,C.: Highway 
Users Fedenition for Safety and Mobility, 1970, 
ED147649 21 pages, 1 microfiche. Also available from 
American Driver and Traffic Safety Education Associa- 
tion, 1201 Sixteenth St„ NW, Washington, DC 20036 
(S,60). 

A booklet for use by driver education teachers in 
conjunction with A Resource Curriculum in Driver and 
Tr4fic Safety Education (ED059372), including a learn- 
ing twdule, instructions on how to prepare and use the 
module, and six sample modules. 

Program Guide in Metal Technology^ Santa Ana, Calif.: 
Office of the Orange County Superintendent of Schools; 
and Anaheim, Calif.: Anaheim Lbiion High School 
District- 1973. CMOO 1260 89 pages. 2 microfiche. 
A metal tedinology program designed to provide experi- 
ences in the metal trades, including developing u saleable 
skill and earning u certificate of completion in one or 
more trade ^ircas. 

Richey, Rita C. "The Design, Implementation, and Revision 
of [nstriictional Materials in a Competency- Based Busi- 
ness Education Program." Paper presented at the 
American Educational Research Association annual con- 
ference. New York, New York, April, 1977, EDI41595 
40pag^s. ] inicroficlie. 

An approach to implementing competency -based educa- 
tion programs using a combination of self-instructional 
modules, individualized management processes, and 
group instructional technic^ues designed for and used in a 
comprehensive consumer education program in several 
high school business education programs; a part of 
Project PACT (Pupil Adijevement and Consumer Teach- 
ing), conducted at Wayne State University, Detroit, 
Michigan. 

Adult EducaHon Information 

Midoflcbc Documents 

Adult Career Education Counselifig Prtffect: Final Report. 
Portland, Oreg.: Northwest Regional Educational Labo- 
ratory, 1978, EDI43828 24 pages. I microfiche. 
The final report on a special demonstration project to 
develop, pilot test, evaluate, and disseminate a 
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competency -base d« open-entiy /open-exit training pro- 
gram mode] for adult education guidance and counseling 
personneK leading to the development of SAGE (Skills 
for Adult Guidance Educators), a nine^step training 
^stem. 

Adult Competency Education Profile. Washington, D,C,: 
Buieau of Occupational and Adult Education, 1977, 
ED141593 103 pagps, 1 micronche, 
A compilation of abstracts of 120 current federally 
funded adult performance level (APL) and adult com- 
petency education (ACE) projects being conducted in 34 
states and the District of Columbb, developed for adult 
and secondary education administrators, teachers, and 
program developers who are beginning or are cunently 
involved in APL/ ACE programs. 

Adult Cotnpetency Education Resources, Washington, 
D,C,: Bureau of Occupational and Adult Education, 
1977, ED141592 43 pa^s, I microfiche, 
A compilation of brief descriptions of 20 cunent 
resources for adult performance level (APL) and adult 
competency education (ACE) programs, developed for 
adult and secondary education administrators, teachers, 
and program developers who are beginning or are already 
involved with APL/ ACE programs. 

ne Adult Performance Level Competency-Based High 
School Diploma. Austin, Tex*: University of Texus^ 
1976, 1D005378 44 pages, 1 microfiche. 
A description of the Competency-Based High School 
Diploma Program developed for adults m Texas as a 
flexible alternative to the conventional four-year 
diploma program. 

Oregon Competency* Based Diploma: Adult High School 
Field test model, Roseburg, Oreg.: Umpqua Community 
CoUegp, 1976, 1D00555 6 99 pages, 2 microfiche. 
A model indicating credit requirements and examples of 
competencies and their performance indicators for the 
Adult High School Diploma Program, allowing credit for 
the skilb gained through life experiences. 

A Research and Development Project to Design a System 
and Supporting Materials, to Provide an Adult Perform 
mancQ Level in Four Mttfor SuihAreas for Adult Basic 
Education Austin, Tex*: Texas Education Agency, 
1972. ED101099 75 pag^, 1 microfiche, 
A description of an adult performance level (APL) 
project, in which the primary goal was to produce 



sequential tests of APL objectives derived from the 
requiiements of adult living tn reading, writings compu- 
tation, and gpneral knowledge. 

Special Education Information 

Joumat Artictes 

Cox, Eunice W. "Competency- Based Instruction for Stu- 
dents with Exceptional Learning Needs: A Modular 
Approach to Curriculum Development,*' California 
Journal of Teacher Education. Vol 3 (Fall, 1976), 
47-62, JJ126 

O'DelUStan L.,and others,''€ompetency-Based Training for 
Severely Behaviorally Handicapped Children and Their 
Parents,^' Journal of Autism und Qiildhood Schizo- 
phrenia. Vol 7 (September, 1977), 231--42, JJ130 
Descriptions of the major components of a treatment 
program designed to help severely behaviorally liandi- 
capped children {two to sixteen years old) develop the 
necessary skills to function in regular classrooms or 
special education classes, 

Miciaflche Doaimetits 

Hopkins, Mary A., and Robert J* Bwck, Mcnomonie/UW* 
Stout TMR Program: A Vocational! Life function 
Performance-Based Criterion-Referenced Curriculum 
Menomonie, Wis.: Menomonie School [>istrict and Uni- 
versity ofWUconsin-Stout, 1977. ED146757 300 pages, 
3 mjcroftche. 

The discussion draft of a performance*based, criterion* 
referenced curriculum for teadiing vocational skills to 
trainable mentally retarded (TMR) students, developed 
jointly by the University of Wisconsin at Stout and the 
Menomonie School District admin istration. 

Mauser, August J. A Performance Based Diagnostic Educa- 
tion Package for Teachers to Develop the Concept of 
Time md Telling Time in Learning Disabled CJiildren. 
Springfield, JU.: State Department of Public Instruction, 
1973. ED141987 41 pages, 1 microfiche. Also available 
from Department for Exceptional Cruldren, 100 N. First 
St,, Springfield, IL 62777, 

A performance*based learning package for teachers of 
learning disabled children, providing a list of steps for 
students to take toward obtaining competency in time 
and time telling* 
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Sources of Information on Specific 
Subject Competencies 



Infonnation on Lai^uage Arts Competencies 
Joonul Aitides 

Hutchinson, Laveria **The Components of a 
Competency- Based Elementary Reading Prpgiam/' 
Reading Horizom, VoL 18 (Fall* I977)> 52-^56, JJI22 
A description of the components ofa competency-based 
etementaiy reading program, including the concept of 
mstruction, the elements of a learning module* the 
components of modular developments the role of the 
classroom teacher^ and the level of student performance. 

Raybin, Ron. '^Minimum Pfoficiencies in Pasadena's Secon- 
dary Schools" Phi Delta Kappm. Vd. 59 (October, 
1977). 128-30. JJ13I 

A description of the development and implementation 
ofPasadena's minimum essentials program in EngUsh. 

Midoficbe Documents 

Compose Yourself: A Plan for Instruction in Written 
Composition, Grmies 7'IZ Los Angeles, Calif: Los 
Angeles Unified School District, 1976. CMOOl 161 75 
pages. 2 microfiche. 

The outline of a programofcontinuous composition for 
second ary stu dents, containing details of prewriting 
experiences and five performance competency levels in 
descriptive, narrative, informative, and expository writing. 

Colub, Lester S. A Development Qycle for a Competency- 
Based t'n^sh Curriculum, Crudes K-ll Eric, 1974. 
ED098580 II pages. 1 microfiche. 
A description of the components of a competency-based 
English curriculum, kindergarten thrcKjgh grade twelve, 
including listening, speaking, reading, writing, language, 
literature, and media. 

Functional Reading Resource Manual for Teachers 
(Volumes I and II). Baltimore, Md.: State Department of 
Education, 1975. EDI08177 330 pages. 4 microfiche. 
A curriculum guide, containing objectives»activities» and 
materials for classroom use, designed to meet functional 
reading needs in grades one through twelve. 

Hollifield, John H. The Development of Teams-Games- 
Tournament (TGT) Curriculum Materials for Elementary 
Language Arts (Report No. 238). Baltimore, Md.: 
Center for Socbl Organization of Schools, Johns Hop- 
kins University, 1977. EDI47828 47 pages. 1 micro- 
fiche. 

A description of the development of a complete set of 
curriculum materials using the Teams-Games- 
Toumament (TGT) instructional process. 



Language Art% Cunicubm Gu^e Portland, Oreg.: Parkrose 
School District, 1975. IDCK)536I 106 pages, 2 micro* 
fiche. 

A goal-based language arts teadiing model, inducting 
program goals, course goals, instructional goals, and 
performance indicators. 

Literature Objecth^es: Second Assessment Denver, Colo.: 
Education Commission of the States, 1975. EDI 13737 
18 pages. 1 microfiche. 

The revision of the literature objectives first created in 
1965-66 by the National Assessment of Educational 
Progress. 

MeDon, John C. National Assessment and the Teaching of 
En^ish: Results of the First Natimd Assesmtent of 
Educational ftogress in Writing, Reading and 
Utmsture- l^licaiions for Teaching md Measurement 
in ^e En^sh Language Arts. ERIC, 1975. EDn2427 
133 pages, 2 microfiche, 

A book for English teachers and other persons con- 
cerned about teaching English, containing a description 
of the contents of the writing, reading, and literature 
assessments with a synopsis of the questions asked and 
the answers obtained. 

The Mississippi C^ndog of Competencies for Public Elemen- 
tary and Secondary Langu^^ Arts, Jackson, Miss.: State 
Department of EducaUon, 1975. 1DCK)5603 203 pages. 4 
microfiche. 

A taxonomy of competencies for grades one through 
twelve with separate chapters for worid literature and 
creative writing. 

The Mississippi Catdog of Competencies for Public Elemen- 
tary and Secondary Reading, Jackson* Miss,: State 
Department of Education, 1975. ID005602 159 pages, 3 
microGche. 

A taxonomy of competencies for grades one through six; 
for primary* intermediate, and secondary remedial read- 
ing; and for developmental reading in both jimior and 
senior high school. 

MuDis^ Ina V. S. Highlights and Trends from National 
Assessment- Writing and Change in Writing Skills ERJC, 
1976. EDI288I4 27 pages, I microfiche. 
A discussion of the methods used in scoring the National 
Assessment of Educational Progress (holistic scoring* 
primary trait scoring, and presence/absence scoring) 
along with tables of findings, examples of essays, 
background questionnaires, and scoring guides. 
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Oldefendt, Susan J. Highlii^rs md Trends ftom NaTional 
Assessment: Changes in Reading Achievement* 1970-75. 
ERIC, I976.EDI28766 17 pages, 1 nuciofiche. 
A compilation of the results of the first National 
Assessment of Educational Progress reading assessment 
and the changc-in-adiievement lesults for the Mini Assess> 
ment of Functional Literacy of seventeen year olds, 

Reading Objecirves: Second Assessment Denver. Colo.: 
Education Commission of the States, 1974. ED08923S 
21 pages. 1 microfiche. 

A revision of the objectives used by the National 
Assessment of Educational Progress in reading. 

Reading Performance Directives: A Model: Some Priority 
Performance Oi^ctives in Reading Ninth Grade ^Qui- 
valency. Phoenix, Ariz.: Arizona State Etepartment of 
Education, I97Z ED{)94375 28pagjes. 1 miCTOfiche. 
A sample set of objectives for testing ninth grade 
equivalency reading ability. 

SI^TE: Suf^rt for Learning and Teaching of English 
(Volume 2). Urbana^ 111 : National Council of Teachers 
of English, 1977. EDI46629 22 pages, 1 microfiche. 
A collection of newsletters, produced during the second 
year of activity of a standing committee of the National 
Council of Teachers of English, on standardized testing 
as it affects the teaching of English. 

Suhor, Charles. Mass Testing in Cdmposition: 1$ It hfdrth 
Doing Badly? New Orleans, La.: New Orleans Pubhc 
Schools, 1977. ED147807 27 pages. 1 microfiche. 
A description of the Paul Diederich system for testing 
students' writing skills, which yields statistically tellable 
data on individual students, and a report on a New 
Orleans project in which the Diedench ^stem was 
rmplemented. 

Information on Matfiematics Competencies 

Journal Articles 

Bell, Max S. **What Does Everyman Really Need from 
School Mathematics?"* Mathematics Teacher* Vol. 67 
{March, 1974), 196^202. JJ49 

A list of mathematical concepts that every person needs 
from the school mathematics experience to cope with 
the world. 

Edwards, E. L.« Jr., and others. ^^Mathematical Compe* 
tencies and Skills Essential for Enlightened Citizens/' 
Arithmetic Teacher, Vol. 19 (November, 1972), 
601-607. JJ48 

A list developed by the National Council of Teachers of 
Mathematics teHecting the basic mathematical compe* 
tencies, skills, and attitudes essential for capable citij^ns. 

Micioficlie Documenrs 

Buchanan* Aaron D., and Patricia A. Milazzo. "Proficiency 
Verification Systems: A Large-Scale, Flexible-Use Pro- 
gram for Evaluating Achievement in Mathematics" 
Paper presented at the annual meeting of the American 
Educational Research Association, New York. New 



York, April 4-8, 1977. ERIC, 1977. ED137369 32 
pages. 1 TTUcrofiche. 

A description of proficiency verification qrstems, a 
network of assessment and reporting components which 
can be combined to generate proficiency information 
about individual pupils and groups for use by teachers 
and school administrators, 
Chumbley, Barbara. Mathematics Oi^ectives Skiiis Svsienl 
MO.S.S. San Diego, Calif.: Office of the San Diego 
County Superintendent of Schools and the National 
Elemenury School District. 1976. CM0012S4 184 
pages. 4 microfiche. 

Objectives and criterion-referenced test items for ele- 
mentary math instruction, by grade level. 
Ueberman, Marcus, and others. High School Mathematics: 
Behavioral Obiecnyes and Test Items. ERIC, 1972. 
ED066497 S 1 0 pages. S microfiche. 
An objective-item bank for high school mathematics. 

Leiberman, Marcus, and o\hcTs. Intermediate Mathematics: 
Behavioral Objectives and Test Items. ERIC, 1972. 
ED066495 587pages. 6microriche. 
An objective-item bank for intermediate mathematics. 

Ueberman, Marcus, and others. Junior Higjli Mathematics: 
Behavioral Objectives md Test Items. ERIC, 1972. 
ED066496 236 pages* 3 microfiche. 
An object ive*lt em bank for junior high mathematics. 

Mathematics Cunicuhtm Guide, Portland Oreg.: Parkrose 
School District, 1975.ID005357 32 pages. 1 microfiche. 
A goal-based mathematics teaching nxklel, including 
program goals, course goals^ instructional goals, and 
perfonoaTiGe indicators. 

Mathematics Ol^ectives. Level 8. Project SPPED. Albany, 
N.Y.: State Education Department, 1972* ED067258 
164 pages. 2 miaofiche. 

Mathematics objectives and sample items intended to be 
an aid to teachers in constructing curricula and in 
making classroom goals dear and precise. 
Mathemaiics Objectives^ Level 6. Project SPPED. Albany, 
N.Y.: State Education Department* 1972. ED067237 
190 pages. 2 microfiche. 

Mathematics objectives and sample items intended as an 
aid to teachers in constructing curricula and in making 
classroom goats dear and precise. 

The Mississippi Catalog of Competencies for Public Elemen- 
tary atid Secondary Mathematics. Jackson, Miss*: State 
Department of Education* 1976* ID005604 209 pages* 4 
microfiche* 

A taxonomy of competencies for grades one through 
eight and for separate secondary level courses: Funda- 
mental Math I, FundamentalMathll, Algebra 1, Algebra 
II, Geometry, Advanced Mathematics, Trigonometry, 
and Computer Matl ematics. 

National Assessment of Educational Progress. The First 
National Assessment of Mathematics: An Overview. 
Denver, Colo.: Education Commission of the States, 
1975. ED127t98 64 pages. 1 miaofjche. 
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A sumniaiy of the results of a nationwide 
survey of the rmtherrutical abiUiy of young Americans 
by age level (nine-year-olds, thirtecn*yeaiolds. 
seventeen A ear*olds. and young adults ages twenty-sLx to 
thiriy-five) and by sex- r^*-^- region of the countiy. level 
of parental education* and size and type of community. 

Norris* Eleanor L„ and John Bowes, Nanonai Assess- 
ment of EducanoTud Phj^ress, Alathetnaiics Objectives, 
ERIC* 1970, ED063140 41 pages. I microfiche. 
The mathematics objectives of the National Assessment 
of Educational Progress classified under three dimen- 
sions: O) ihe use of mathematics: (2) content domain: 
and (3) objectives or abilities. 

Objectives for the Minimum Proficiency Levels in Mathc* 
matici Monterey, Calif,: Monterey Peninsula Unified 
School District, 1977, IIX)05964 14 p^igjes. 1 microfiche, 
Thirty^four objectives for a high school graduate^s 
minimal competency in mathematics, followed by the 
school district's graduation level math proficiency test 
and its scoring key. 

Systematic Teaching and Measuring Matlieniatics (STAMM) 
Mini-SampleK Lakewood, Colo.: JefTeison County Pub- 
lic Schools. 1977* ED144843 34 pages. I microfiche. 
An overview and a sample of some of the curricular 
materials developed in Jefferson County's Systematic 
Teaching and Measuring Mathematics (STAMM) pro- 
gram, which provides for continuous progress in mathe- 
matics, in kindergarten through grade twelve, using 
management by objectives. 

Information on Competencies tn Other Subjects 

Jfnirnal Artide^ 

Cook. J. Marvin. "Vicwpoint-Measurcineni of Affective 
An Objectives, * School Ans. Vol 77 (October. 1977). 
14-17. JJi:7 

An article containing arguments to support the c\>n1en- 
lions that wayii can bo created to measure afleciive 
objectiveii in art and that instructional objectives may 
include affective criteria rebted to cognitive or pqrcho- 
mt>tor competencies in art. 

Microfiche DocumenlK 

Basic Otizensiiip Omipetenciei Pacifica, Calif: Oceana 
High SchtM)!. 1976. 1D005.181 |4 pages. 1 microfiche. 
A citizenship competency system that was developed in 
response to a 1976 needs assessment survey and the 11a ri 
Act, including the general program goal, student compe- 
tencies and performance indicators, and the Basic 
Citizenship Competency Examination. 

Basic Science mid Envinmmentai Curriculum (hiide. l\>rl- 
land, Oreg.: Parkrose Sdi04>l District, 1976. 1D005358 
109 pages. 3 micronche, 

A goal*based model for basic science and environmental 
instruction^ including program goals^ course goah. 
instructional goals, and performance indicators. 



Cbnsunier Education Onnpetenciet Harrisburg. Pa.: State 
DepartJTient of Education. 1976. 10005,^76 26 pages. I 
micronche. 

A list of general competencies in four areas: value 
systems for consumers, decision-making procedures, 
rights and responsibilities of the consumer* and the rde 
of tlie consumer in our economic q^stem* 

Cunicukim Objearves, Grade 7^ Science. Bakersfield, 
Calif: Office of the Kem County Superintendent of 
Schools and Panama Union Elementaiy School District, 
n*d* CM00131 1 121 pages. 3 microfiche, 
A curriculum objectives gMide for grade seven, consisting 
of proficiency requirements and proficiency tests for life 
science and biological science, 

Oirricutum Objectives, Grmles 7 and S: Pnbtlc SpeakingI 
DranUL Bakersfield* Calif,: Office of the Kem County 
Superintendent of Schools and Panama Union Elemen- 
taiy School District, n.d. CM001239 61 pages. 2 
microfiche. 

l>tailed proficiency statements for the areas of public 
speaking and drama. 

Emerging Career Deveiopment Portland* Oreg.: Parkrose 
School District, 1974. ID005369 131 pages, 3 micro- 
fiche- 

A goal-based model for emerging career instruction, 
including program goals, course goals* instructional 
goals, and performance indicators. 

He^dth Education Curricuhmt Otddc Portland* Oreg.: Park- 
rose Sdiool District* 1976. 10005,165 68 pages. 2 
microfiche. 

A goal-based model for health education instruction, 
including program goals* course goals, instructional 
goals* and performance indicators. 

Home Economics Department Curriculum Guide, Portland. 
Oreg,: Parkrose School District. 1975. 10005.164 54 
pages, 2 microfiche. 

A goal-based model for home economics Instruction, 
including program goals, course goals, instructional 
goals, and performance indic^ators. 

La\V'F(}Cused Education: iowa, Dcs Moines, Iowa: State 
Department of Public Insi ruction* 1977. ED14721 1 1 24 
pages. 2 microfiche. 

A resource booklet to help secondary students leam 
about the civil law portion of Iowa's judicial system. 

Media Lli^ary Skills. Nine Competency Areas* Cott 
tinuum Sacramento* Calif.: Office of the Sacramento 
County Superintendent of Schools, 1977. CM001.117 55 
pages- 2 microfiche. 

An outline of proficiencies in libraiy media skills for 
kindergarten through grade twelve, including audio 
awareness, equipment use* human resources, leisure 
skills, literaiy heritage, orientation/ appreciation, produc- 
tion, resource and reference, visual communications, and 
a special section on proficiencies required for student 
as^stants enrolled in credit courses at the junior high 
and high school levels. 
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The North Carolina Social Studies Curriculum: A focus on 
People, Culture and Qimge. Rjleigh, NX.; StJte Deport- 
ment of Public Instruction, 1976. EDI39717 50 pages. I 
microfiche. 

Guidelines, objectives, and competencies of the kinder- 
garten through grade twelve social studies program. 

Performing Arts Department Course Goats. Portland. Oreg.: 
Parkrose Public Schools, 1975. ID005360 51 pages, 2 
microfiche. 

A goal-based model for performing aris instruction, 
including program goals, course goals, instructional 
goals, and performance indicators. 

Personal finance Education Guide. Salem, Oreg.: State 
Department of Education, 1972. IDCK)5375 34 pages. I 
microfiche. 

A guide to help districts develop personal finance 
instructional programs at the secondary level, including 
program goals, performance indicators, suggested Icarn^ 
ing experiences, and evaluation techniques. 
Physical Education dtrriattum Guide. Portland, Oreg.: 
Parkrose School District, 1976, IDCK)5374 16 pages. I 
microtlehe. 

A goal-based model for physical education instruction, 
including program goals, course goals, instructional 
goals, and performance indicators. 

Proposed Personal finance Guide. Ponland, Oreg.: Parkrose 
Public Schools, 1976. IDO05372 28 pagps. I microfiche. 
A goal-based model for personal finance instruction, 
including program goals, course goats, instructional 
goals, and performance indicators. 

Social Studies dtrricutum Guide. Portland, Oreg.: Parkrose 
Public Schools, 1976. ID005359 74 pages. 2 microfiche. 
A goal-based model for social studies instruction, includ- 
ing program goals, course goals, instructional goals, and 
performance indicators. 

Information on Competencies in 
Multiple Subjects 

Microfiche Documents 

Arithmetic Proficiency Test Goals and Proficiency Test: 
Written Expression El Segundo, Calif.: Et Segundo 
Unified School District, 1978. ID005925 22 pages. I 
microfiche. 

A discussion and listing of the educational objectives, 
proficiency statements, and proficiency tests for arith- 
metic skills and language arts, including specific refer- 
ence to grammar, spelling, sentence structure, and 
business forms. 

Basic Competencies for High Scfwol Graduation, San 
Diego, Calif,: San Diego City Unified School District, 
n.d. ID005537 II pages. I microfiche. 
A preliminary list of basic competencies for high school 
graduation presented for discussion purposes. 

Basic Exit Skills. Watsonville, Calif,: Pajaro Valley Unified 
School District, 1977. IDO05545 8 pages. I microfiche. 



A list of performance indicators in reading and mathe^ 
maties for students completing grades three, six, eight, 
and twelve. 

Basic Skilf Standards: Writing, Reading, and Mathematics. 
Watsonville, Calif.: Pajaro Valley Unified School Dis^ 
trict, 1978. ID005924 17 pages, 1 microfiche. 
P^rfurmance objectives or standards for students in the 
areas of writing, reading, and matliematies for grades 
three, six, eight, and twelve. No test items are included. 

Competenc}"- Based Education: Selected Programs. Fair- 
field, Calif.: Fairfield^ uisun Unified School District, 
1975, ID005552 96 pages. 2 microliche. 
Four pamphlets outlining the suggested four-year course 
schedule for completing common core objectives, the 
program core competencies, and the major competencies 
in four program areas: public services, business, agri- 
culture, and the special core (environmental skills, 
consumer skills, values). 

Computation, Reading* mid Writing Qmipetencies for the 
Student of the San Mateo Union ^igh Scfiool District. 
San Mateo, Cahf.: San Mateo Union Higli School 
District, 1976. ID005377 13 pages. 1 microfiche. 
Terminal objectives for student performance arc hsted in 
three subject areas: computation, reading, and writing. 

Conrse of Study for Grades Kindergarten Through Eighth 
1976^78. San Mateo, Cahf.: Office of the San Mateo 
County Superintendent of Schools, 1976. CM001274 
147 pages. 3 microfiche. 

A course of study covering all designated curricular areas 
for kindergarten through grade eight. 

Elementary Course of Study Guide, Alaska, Juneau, 
Alaska: State Department of Education, 1977. 
IDCK)5817 75 pages, 2 microfiche. 
A course of study guide containing definitions of tlie 
essential skills for the elementary curriculum in the areas 
of mathematics, social studies, science, and communica^ 
tion skills, to be used as a framework or guideline by 
school districts* 

Elementary School Essential Objectives and Performance 
Indicators. Fairfield, Calif,: Fairfield Suisun Unified 
School District, 1977. IDCK)5553 132 p^es. 3 micro- 
fiche. 

Recommendations for specific changes on the essential 
objectives to be completed for each subject area at each 
grade level from kindergarten tlirougli grade six. 

Higfr School Graduation Requirements and Competency 
Examinations: Ovic Awareness, Computational Skills, 
Communication Skills and Consumer Education. Car- 
michael, Calif.: San Juan Unified School District, 1977. 
IDCK)555074 pages. 2 microfiche. 
A list of minimum competencies for high school 
graduation and four revised competency tests: civic 
awareness, basic computation skills, basic communica^ 
tion skills, and consumer education. 
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buermediaie School f.sseniial Objcarvcs ofui Perfomiance 
hidkators, Fuirfleld. Calif: Fairfield-Suisun Unifitd 
School Districl, 1977, 1D005554 82 pa^s, 2 iracrofichc. 
Four pamphlets describing the Fiiirtteld-Suisun Unified 
School District's junior high cooipetency-based program, 
listing essential objectives and providing examples of 
student perform;ince objectives ^nd pertorm;incc 
indicators. 

Mininmm Gnnpeteucies for Graduation Final report of the 
South Monterey County Schools Curriculum Workshop- 
Salinas, Calif,: Office of the Monterey County Super- 
intendent of Schools, 1975, CM001282 37 pagps, 1 
microfiche- 

The final dmft of the South Monterey County Schools 
Curricul um Workshop recommendations for minimum 
standards of ^'ompetence in language arts, mathematics. 



and science for graduation from high school, including 
procedures for developing local graduation requirements 
and a sunnnaiy of RISE recomtnendattons and Cali- 
fornia legislation on graduattOTi requirements. 
Reading Comprehension Test Specifications, Miiiitnum 
Writing Test SpeciflcationSt Conipmation Test Specifica- 
tiofts. El Monte, Calif,; El Monte Union High School 
District* 1978. ID005926 1 6 pages. 1 microfiche. 
A compilation of test specifications for reading compre- 
hension, minimum writing* and computution skills. 

Shepardson, Marie E., and others. Finai Amiysis attd 
Annotated Bibiiop-aphies Eug&ne, Oreg,: University of 
Oregon. 1977, ED142I89 188 pages, 2 microfiche. 
Three analytic papers and three annotated bibliographies 
on mathematics^ reading, and competency- based edu- 
cation. 
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Sources of Information on Tests, 
Testing, and Assessment 



Joumal Articles 

Day, Gerald F< "Criterion- Referenced Measurement," Manj 
Society jTechnolo^, Vol 35 (Etecember, 1975), 84— 86, 
ii5] 

A consideration of the uses for criterion-referenced 
measurement and the construction and use of criterion- 
refeienced tests. 

Fillbrandt, James R^, and William R, Merz* "Minimum 
Proficiencies and the Fine Art of Setting Standards,'' 
NASSF BuUetifu Vol 62 (February, 1978), 70-80, 
JJI19 

An outline of the process of generating student profi- 
ciency tests, including item generation, pilot testing, 
tailoring proficiency measurement to job market needs, 
using community members as sample test populations, 
and analysis of test results. 

Oilman, David Alaru "Minimum Competency Testing: An 
Insurance Policy for Survival Skills " NASSF BuUetttt, 
Vol 61 (March. 1977), 77-84, JJl 17 
An article in support of the argument that minimum 
competency testing will determine standards for learning 
and will effect a massive critical reassessment of educa- 
tional programs. 

Madaus, Coergc F., and Peter W. Airasian. "Issues in 
Evaluating Student Outcomes in Competency-Based 
Graduation Programs,'* Journal of Research and Devel- 
cement in Education. Vol. 10 (Spring, 1977)> 79-9L 
JJl 29 

A discussion of the evaluation problems posed by 
competency-based graduation requirements. 

Micfofiche Documents 

Alternative Methodologies for Competency Based Educa- 
tion: The State-ofthe-Art Portland, Oreg*: Northwest 
Regional Educational Laboratory, 1976. ED147948 158 
pages. 2 microfiche. 

A review of the state of the art of competency-based 
education (CBE) and a discussion of alternative methods 
for the development of CBE programs in public sdiool 
^stems. 

Annotated Bibliography on Applied Performance Testing 
Portland, Oreg*: Northwest Regional Educational Labo- 
ratory, 1975.10005605 64 pages. 2 microfiche. 
An annotated bibliography, containing nonevaluative 
summaries of documents grouped by content area: 
concepts, development, application, and bibliographies 
on applied performance testing; language arts; life ^ills; 



mathematics; physical education; sciences and vocational 
education. 

Behnke, Grant. A Call for Statewide Criterion-Referenced 
Test Item Fools. San Diego, Calif.: San Diego Unified 
School District* 1975. 1D005955 9 pages. 1 microfiche. 
A paper written to advocate the initiation and support 
of efforts to create a quality criterion-referenced testing 
item pool based on a set of state benchmark objectives. 

Bernstein, Ruby S., and Bernard R^ Tanner. The California 
High School Proficiency Examination: Evaluating the 
Writing Samples. Curriculum Publication No. 1. Report 
of the Bay Area Writing Project. Berkeley, Calif.: 
University of California, 1977. ED147806 25 pages. I 
microfiche. Also available from Bay Area Writing Proj^ 
ect, 5637 Tolman Hall, University of California, Berke- 
ley, C A 94720. ($1.50). 

A discussion of the writing sample whidi is part of the 
California High School Proficiency Examination, includ* 
ing a description of the test, an outline of the methods 
of scoring, and examples of candidates' responses at 
various scoring levels. 
Competency Statements and Performance Indicators. San 
Jose, Calif.: Office of the Santa Clara County Superin- 
tendent of Schools, 1978. ID005927 8 pages. 1 micro- 
fiche. 

A compilation of competency statements and perfor- 
mance indicators developed for an assessment package 
related to AB65. 
Considerations for Proficiency mid Competency Testing 
Ptinceton, NJ.: Educational Testing Service, n.d. 
ID005534 6 pages. 1 microfiche. 
An examination of the procedures for and the academic 
and social considerations in establl^ing proficiency 
assessment programs. 

Ebel, Robert L. Some Thoughts on Testing for Minimum 
Competency. East Lansing, Mich.: Michigan State Uni- 
versity, 1977. ID005956 7 pages. 1 microfiche. 
A discussion of the history of competency requirements 
and their importance in education, including an analysis 
of the causes of the decline in mastery of basic skills and 
the positive efteas of minimal competency testing* 

Educational Assessment Program: State Report 1976-77: 
Trenton, N.J.: State Department of Education, 1977. 
ID005967 331 pages. 6 microfiche. 
The report of the New Jersey Educational Assessment 
Program for 1976*77, containmg an analysis of the 
results of the reading and mathematics tests adminisp 
tered to students enrolled in grades four, seven, and ten. 
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Engiish and Math Proficiency txmiinatioiis. Kg Bear Lake, 
Calif: Bie Bear High School; and Concord, Calif: 
Ygnacio Valley High SchooL 1977. 1D005548 14 pages. 
1 microfiche. 

The English and math proficiency tests used to place 
incoming freshman at Big Beur H^ School and an 
English competency examination from Ygnacio Valley 
High SchooU California; no scoring or test administni- 
tion Information. 

Esles, Gary D., and others. A Criterion-Referenced Basic 
Skilk Assesstnent Program in a Large City School 
System, ERIC, 1976. ED124587 20 pages, 1 microfiche. 
A discussion of the procedures and considerations used 
In developing a basic skills assessment program. Including 
preliminary results on validity and reliability of the 
assessment instruments. 

Fink, Arlene, The Use of Data from Competency- Based 
Measurement: An Instructional Developer's K/ew. ERIC, 
1976. EDI 28469 14 pages, 1 microfiche. 
A review of the difficulties in developing competency- 
based achievement tests^ including problems in finding 
expertise, formulating test Items, and validating tests. 

Georgia Statewide Testing Program Atlanta, Ca.: Slate 
Etepartment of Education. 1976. 1D005390 39 pages. 1 
mjcrofiche, 

A description of the Georgia Statewide Testing Progiam; 
a list of objectives for grades four and eight in reading, 
math, and career development; and sample questions 
from the criterion referenced mathematics tests for both 
grade levels. 

Junior High Unified: Sequencing and Keying of Unified 
Studies: Test Specifications for Q'iierion-Referenced 
Testing: Achievement^A\varenes:s Record fijr Language 
Arts, Shawnee Mission, Kans.: Shawnee Mission Public 
Schools. 1975.ED116193 1 24 pages. 2 microfiche. 
A language arts cuniculum guide for grades seven 
through nine designed to synthc&i/e language arts skills 
with social studies, 

Klein, Stephen P„ and Jacqueline Kosecoff. Isisues and 
Procedures ift the Develc^nient of Criterion- Referenced 
Tests, ERIC. 1973^ ED083284 18 pages. 1 microfiche. 
A discussion of the basic steps tn developing criterion- 
referenced tests as well as the attendant issues and 
problems. 

KofTIer, Stephen L, Basic Skills Mastery' of New Jersey Y' 
College Bound Students. Occasional Papers in Educa- 
tion, Trenton, NJ,: State Department of Education, 
1976. EDI46234 57 pages. 1 microfiche. 
A discussion of the results of a 1975 statewide assess- 
ment of the basic skills mastery of a random sample of 
college-bound students in New Jersey. 

Koffler, Stephen L, The Basic Skills Thmsi: An Investiga- 
tim into Its Effecti)?eness, Occasional Papers in Edu* 
cation. Trenton, N.J.: State Etepartmeni of Education, 
1978. 1D005962 20 pages, 1 microfiche. 



A comparison of the 1976-77 and 1977-78 results of the 
New Jersey Educational Assessment Program's statewide 
testing of students in grades four, seven, and ten- 
indicating that the decline of basic skills niasteiy in New 
Jersey seems to have been stopped. 

Math Proficiency Test and Teacher^s Guide. Redondo 
Beach, Calif: South Bay Union High School District, 
1977,10005543 H pages, 1 microfiche. 
The mathematics proficiency test given to district 
freshmen and seniors and the teacher's guide to the test 
which correlates competencies to performance indicators 
and sample test items. 

Measuring Performance: Verifyuig Competencies Tfirvugh 
Observation md *^i^^ttienL Salem, Oreg.: Slate I>part- 
ment of Education. 1977, ED144990 40 pages. 1 
microfiche, 

A guide developed to assist Oregon school districts in 
meeting revised minimum state standards for planning 
and assessment, including a discussion of the teacher's 
role In judging student performance with respect to 
satisfying graduation requirements and guidelines for 
implementing an effective system of using teacher 
judgments in assessing students* life skills competencies. 

Mione, Stephen A. Criteriot^Refercnced Testing: A Critical 
Perspecti^^e, ERIC, 1977, ED147757 27 pages. 1 micro- 
fiche, 

A review of the literature related to criterion-referenced 
testing, which has been tied to trends in individualized 
instruction, competency-based education, and the 
accountability movemenL 
Mullis, Ina V, S, The Primary Trait System for Scoring 
Wnti^ig Tasks, ERIC, 1976. ED124942 34 pages. 1 
mjcroHche. 

A presentation of the rationale and procedures for 
implementing the National Assessment of Educational 
Progress system of scoring writing papers^ including a 
national assessment exercise, the scoring guide developed 
for the exercise, sample responses for the score points, 
and the national results for this exercise. 
Nickse, Ruth S. Development of a Performance Assessment 
System for the Central New York External f^igli School 
Diploma Program: An Educational Alternative for 
Adults: A Progress Report. ERIC, 1975. EDI 10740 34 
pages. 1 microfiche. 

A description of the development of an alternative 
performance assessment procedure for certifying adults 
at the secondary school level in the New York External 
High School Diploma Program. 

O'Reilly, Robert P„ and R, T, Schuder. "Some Issues In the 
Measurement of Basic Competence In Reading." Paper 
presented at the annua) meeting of the American 
Educational Research Association, New York, New 
York, April 4-8, 1977. ED148897 56 pages. 1 micro> 
Hche. 

A discussion of the content and utility of two models of 
reading comprehension tests: the basic skills assessment 
model and the multiple choice clo:!e model. 
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Proficiency Tesi in Wring Quesiiounairc. Redwood City. 
Calif.; Sequoia Union High School District. 1^76. 
1D0053S5 5 pages. 1 microfiche. 
A short questionnaire, addressed to students* p^ircnts* 
school staff, and communis members, asking for 
feedback on the district's proposed objectives and 
sample proficiency test on writing. 

Rojas, Virginia P. District Utilization of the Statewide 
Testing Frogrant Occasional Papers in Education. Tren- 
ton. NJ.; State Etepartment of Education. 1977. 
ED147326 55 pages. I microfiche. 
The results of a survey of all local school superinten- 
dents regarding their districts' uses of the statewide New 
Jersey Educational Assessment Program data, including 
program changes, instructional changes, administrative 
changes, and dissemination of information. 

Sachse, Thomas P- and James R. Sanders. Applied Perft^* 
mame Tesnug. SMERC. 1975. 1D005539 100 pages. 2 
microfiche. 

A status report on applied performance testing and the 
efforts of the Clearinghouse on Applied Performance 
Testing; a 60-page bibliography related to applied perfor- 
mance testing; and guidelines for the evaluation of 
applied performance tests. 

Sample Assessntcnt Exercises Manual for Froficiency 
Assessment. In two volumes. Sacramento. Calif.: State 
Etepartment of Education^ 1978, (Vol. 1; Sample Exer- 
cises, Vol. 11: Item Statistics for Grades 7, 9, and //.) 
Vol. 1: 1D005952 389 pages, 7 microfiche; Vol. 11: 
1D005953 1000 pages. 22 microfiche. 
An additional source of technical assistance to school 
districts in implementing the proficiency requirements 
of A& 3408 and A& 65, designed to accompany the 
Technical Assistance Guide for Proficiency Assessment 
(ID005596). Volume 1: item specifications and sample 
assessment items jn three models: school context, 
functional transfer, and applied performance; Volume 
II: a detailed description of the field test, an explanation 
of the reading and use of the item statistics, and item 
statistics for most of the items in Volume I. 

Sample Competency Tests, Portland, Oreg.: Parkrose 
School District* 1976. 1D005355 76 pages. 2 microfiche. 
Samples of multiple choice tests and instructions for 
administering mathematics competency tests. 

Schalock, H, D. Alternative Models of Competency Based 
Education (Second edition). Portland* Oreg.: Northwest 



Regional Educational Laboratory, 1976. ED14795 1 183 
pages. 2 microfiche. 

A historical and conceptual review of the educational 
practices related to competency -Ixised education, a 
proposal for a working definition of comnentency -based 
education, an exploration of the implications of the 
definition, and a discussion of alternative programs to 
illustrate the variety among competency-based education 
programs. 

Selected Math Competency Examinations, Bellflower, 
Calif.: Bellflower Unified School District; Elk Grove, 
Cahf.: Elk Grove Unified School District: and Concord, 
Calif,: Ygnacio Valley High School, n-d, 1D005544 30 
pagps. 1 miaofiche. 

Statements of mathematics competencies and the profi- 
ciency examinations for measurement of these compe- 
tencies from two California school districts and one high 
school. 

Senior Nigh Assessfnent of Reading Perfonuance, Los 
Angeles, Calif,: Los Angeles Unified School District, n.d. 
ID005383 25 pages. 1 microfiche. 
An information packet on the contents and objectives of 
SHARP, including sample questions and a list of 
remedial instructional kits for students who have failed 
specific test objectives. 

Socid Studies Froficieftcy Test, Redwood City, Calif.: 
Sequoia Union High School District, 1976. 1D005387 48 
pagps. 2 miaofiche. 

Sample test items to measure social studies skills; the 
framework for coordination of district social studies 
departments; and a matrix relating the program objec- 
tives to each social studies course offered by the district. 

Test Collection Bibliogmphies: Qiterion-Referenced Mett 
sures, July, 1973, Compiled by Pamela Rosen. ERIC, 
1973. ED 1049 10 18 pages, I microfiche. 
An annotated bibhography of available criterion- 
referenced measures. 

Wilmer, Mary Ann. Minimum Basic Skills Survey Results. 
Occasional Papers in Education. Trenton, NJ.: State 
Department of Education, 1977. (D005959 63 pages. 2 
microfiche. 

The results of a surwey conducted by the New Jersey 
Department of Education in the spring of 1977 to 
obtiiin a statewide consensus on which skills should tie 
minimum requirements for a student's completion of 
grades three, six* nine, and eleven. 
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Unlike the iterm listed in the previous sections, the 
resources listed in this section are not available from 
SMERC* However, they are considered ofsufncientimpor* 
tanoe and convenient availability to be included along with 
the information necessary to order copies. 

An Assessment of ihe Miting Performance of CaHfomia 
School Seniors. Saaamento, Calif.: State Etepart- 
ment of Education. 1977. 29 pag^s. S2.75 plus sales tax. 
Available from Publications Sales, California State 
Department of Education* P.O. Box 271, Sacramento, 
CA 95802- 

This publication contains the results of a 1975 study 
conducted throughout Califomia to determine (!) the 
degree to which the results of the written portion of the 
grade twelve assessment examination provided a valid 
measurement of writing ability; (2) the degree of writing 
competency demonstrated by Califomia's high school 
seniors; and (3) the most typical strengths and weak* 
nesses of the writing skills of those high school seniors. 

Basic Skilis Assessment: Manual for Scoring the Writing 
Sample. Princeton, NJ.: Educational Testing Service, 
1977. 40 pages. S3. Available from Educational Testing 
Service, Princeton, NJ 08540. 

This publication includes a discussion of the philosophy 
and procedures involved in analytical and holistic 
methods of scoring basic writing skills assessments and a 
guide to the use and scoring of the Educational Testing 
Service's Basic Skills Assessment Writing Program. 

Brickell, Henry M. Let's Tdk About * . - Minimum Conipe- 
taicy Testing. Denver, Colo.: Education Commission of 
the States, 1978. 38 pages. M copies S5 each-less for 
quantity orders. Available from Education Commission 
of the States, 300 Lincobi Tower, I860 Lincoln St., 
Denver, CO 80295; (303) 861-491 7. 
A combination discussion guide and mailable question* 
naire to inform and record public and professional 
thinking on competency*based education and minimum 
competency testings 

The California Evaluation Improvement Project materials 
Workbook on Program Evaluation {S8-$6.75 e:ich for 

more than 25 copies) 
Program Evaluator's Guide (S12- S10 each for more 

than 25 copies) 
Evaluation Ihiiner's Guide {S9,50 each) 
CKVAL Elemeniary School ($20) 
Princeton, NJ,: Educational Testing Service, I97S. 
Available from Evaluation Improvement Program, Edu* 
cational Testing Service, Box 2845, Princeton, NJ 
08541. 



A comprehensive packet of inscrvice training materials 
designed and field*tested over a period of three years by 
practitioners in California schools, the Califomia Evalu* 
ation Improvement Project materials are directed at 
teachers, principals, and other program managers who 
want to be able to evaluate their own programs for their 
own use. The materials were developed for use in three- 
or four-day workshops, but are equally useful in other 
continuing-education modes. The Workbook o^i Program 
Evaluation is a do-it-yourself recording notebook with 
guiding text designed to guide the tiser through the 
component activities in program planning and evalu* 
ation: purposes, needs assessment, goals and objectives, 
evaluation design, assessment instruments, data coUec* 
tion, data analysis,data processing, program monitoring, 
program reporting, requirements, and resources. The 
Program Evatuator's Guide contains a discussion of the 
concepts and theories of program evaluation and a 
step*by-step guide to the developing and carrying out of 
a comprehensive plan of evaluation. The Evduation 
Trainer's Guide Is a detailed manual for teaching 
program evaluation workshops based on the Program 
Evaktaior's Guide^ CEVAL Elementar}' School is a 
simulation exercise for use in training educators in the 
judicious allocation of limited resources, the anticipation 
of issues, and the generation of evaluation information 
that will be useful in addressing issues. It includes 
handouts, an instructor's guide, and an audiocassette to 
pace the exercise. 

Competency Based Education Sourcebook (Second edi- 
tion). Northwest Regional Educational Laboratory, 
1978. 560 pages. $24.50. Available from Office of 
Marketing, Northwest Re^onal Educational Labora* 
tories, 710 S-W. Second Ave,, Portland, OR 97204; 

. {503)248-6800. 
A comprehensive guide for curriculum planners, adminis* 
trators, teachers, and others involved in the planning and 
implementation of competency*based education. 

The Competency Omllaige: What Schools Are Doing. 
Arlington, Va*: National School Public Relations Associ* 
ation, 1978. 96 pag^s. $7.95. Available from National 
School Public Relations Association, Dcpt, 78*67, 1801 
N. Moore St., Arlington, VA 22209. 
An in-depth look at the issues involved in competency* 
based education, including constructing, administering, 
evaluating, and explaining competency tests; detailed 
accounts of specific state and local programs; case 
histories; and samples of competency tests currently in 
use. 
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Cooper, Charles TL, and Lee Odell. EvalmTing Wriring: 
Describing, Measuring, Judging. Urbana. 111.: National 
Council of Teachers of English, 1978. S5.75 plus SI. 50 
shipping and handling. Available from National Council 
of Teachers of English. 1111 Kenyon Road,Urbana,lL 
61801:(217) 328-3870. 

A discussion of the purpose of and procedures involved 
in the ev^aluation of basic writing skills. 

A Guide to identifying Hi^i School Graduation Competen- 
cies: Issues mid Examples. Portland, Oreg.: Northwest 
Regional Educational Laboratoiy^ 1978. 144 pages. 
$6.50. Available from Office of Marketing, Northwest 
Regional Educational Laboratory, 710 S,W. Second 
Ave., Portland, OR 97204; (503) 248-6800. Funded by 
the National Institute of Education and developed after 
three years of consultation among educators from many 
states, the guide contains a list of 77 competency 
statements and descriptions of how they were selected. 

McClung, Merle Steven. "Competenc>- Testing and Handi- 
capped Students." Oeannghouse Review. Vol. 1 1 
(March. 1978), 922-26. 

This article is a discussion of the fairness and legality of 
competency testing prcrgrams for the handicapped. 
Questions are raised concerning exceptions for handi- 
capped students* individual detenninations, differential 
standards and diplomas, and differential assessment 
procedures. 

McClung, Merle Steven. "Competency Testing: Potential 
for Discrimination," Qearinghouse Review. Vol. I I 
(September. 1977), 439-48. 

This article contains a discussion of the potential for 
discrimination in schools and districts in which compe- 



tency testing is started. Areas addressed in the article 
include the following: racial discrimination, inadequate 
phase-in periods, unreliable or unvalidated tests* inade- 
quate matching of the instructional program to the test, 
inadequate remedial instruction, and unfair apportioning 
of responsibility between students and educators* 

The two articles by Merle McCIung are available from 
the National Clearinghouse for Legal Services, 500 N. 
Michigan Ave., Suite 1940* Chicago, IL 6061 1; S2 for 
entire issue* including postage and handling. 

Resources for Assessing Language Proficiency in Spanish, 
Los Alamitos, Calif.: SWRL Educational Research and 
envelopments 1978. A set of materials Including a 
storage album, one Resource User Manual, one Resource 
Usage Log, one Teacher BookleJ for the initial evalu- 
ation and for each of the three proficiency levels, three 
cassette tapes, g^me materials, 100 student proficiency 
summaries, 100 initial evaluation booklets, and 30 
student record booklets for each of the thiee levels. S50 
for the complete set; S5 for a preview set Available 
from lesion of Resource Services, SWRL Educational 
Research and envelopment, 4665 Lampson Ave., Los 
Alamitos, CA 90720. 

Resources for Assessing Language Proficiency in Spanisli 
ts a set of materials written completely in Spanish 
designed to allow bilingual school personnel to deter- 
mine and describe an individual student's proficiencies in 
understanding! speaking, reading, and writing Spanisli. 
The resources are not a test of language dominance or 
general aptitude; they are tools for use in planning, 
evaluating, and guiding instruction to build on present 
Spanish-language proficiency. No training is necessaiy to 
use the materials. 
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Ordering Information 



Duvoments cited in this cataJog ore available froin the San Mateo EdocationaJ Resources Center 
(SMERC) or troni sources died in the section '*MaterialsNot Available from SMERC on pages 18 and 19, 

Costs tu agencies subsi:ribing to SMERC are lower than the costs tu nonsubscribing agencies. A list uf 
SMERC subsi:ribing agencies is printed inside the back cover 

Cost for SMERC Subscnbets 

Any educator in an agency contracting with SMERC may request free microfiche reproduction uf up to 
ten microfiche cards, after which a charge of 50 cents per microfiche card is assessed. 

Juumal articles (those with '*Ji ^ nun^rs) are available in photocopy format only, A maximum uf 20 
pages will be reproduced at no cost« after which 15 cents is charged for each pag^. 

Cost for Nonsubscribets of SMERC Services 

Anyone may order reproductions of documents from SMERC. The charges for persons whu are not on 
the staff of a subscribing agency arc as follows: 

75 cents per microfiche card 
20 cents per photocopy page 
S2 fur handling 

Payment must accompany tlie order. 

How to Order from SMERC and Other Resource Agencies 

Ordering should not be done by title* but by identification number-tlie nun^r beginning with "'ED'* 
(ERiC documents); "ID" and "CM" (SMERC documents): or ''JJ'' (journal articles). Orders* which must 
also include the number of pages, the number uf microfiche, and the date of publicatiun^ should be sent to: 

Educational Resources Center 

San Mateu Superintendent uf Schuuls 

333 Main St* 

RedwuudCity,CA 94063 
(415) 364r5 600; vxt; - 4 4O4- 

Copies of the documents cited in this catalog are also available at the fulluwing resuurce centers, where 
educaturs may review materials ur have copies made: 

San Diegu Instructional Resources Center 
6401 Linda Vista Road 
San Diego, CA 92111 
(714) 292-3557 

LANCERS (Los Angeles Center fur Educatiunal Research Services) 
9300 E Imperial Hwy. 
Downey, C A 90242 
(213) 922-6397 

ACCESS 

Contra Costa County Superintendent of Schools 
2371 Stan well Dr. 
Concord, CA 94520 
(415) 689-4353 

Information for ordering the documents cited in the section '"Materials Not Available from SMERC* is 
included with the document entries. 

For muie information, call Education Information Resource Service* State Department uf Educatiun, 
(916) 322-6140. 
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